-- Logs begin at Thu 2022-01-27 16:05:34 UTC, end at Thu 2022-01-27 17:06:51 UTC. -- Jan 27 16:40:21.737316 dv-cinder-818830-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 27 16:40:21.746853 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jan 27 16:40:21 2022] *** Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: nodename: dv-cinder-818830-2-iscsi Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: machine: x86_64 Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: clock source: unix Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: pcre jit disabled Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: detected number of CPU cores: 4 Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: current working directory: / Jan 27 16:40:21.748949 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: detected binary path: /usr/bin/uwsgi-core Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: your processes number limit is 47680 Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: your memory page size is 4096 bytes Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: detected max file descriptor number: 2048 Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: lock engine: pthread robust mutexes Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: thunder lock: enabled Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 27 16:40:21.749540 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 27 16:40:21.795370 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: Python main interpreter initialized at 0x55f20318d9c0 Jan 27 16:40:21.795370 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: python threads support enabled Jan 27 16:40:21.795370 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: your server socket listen backlog is limited to 100 connections Jan 27 16:40:21.795370 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: your mercy for graceful operations on workers is 90 seconds Jan 27 16:40:21.795755 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: mapped 403077 bytes (393 KB) for 2 cores Jan 27 16:40:21.795832 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: *** Operational MODE: preforking *** Jan 27 16:40:21.796051 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: *** uWSGI is running in multiple interpreter mode *** Jan 27 16:40:21.796051 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: spawned uWSGI master process (pid: 113355) Jan 27 16:40:21.796262 dv-cinder-818830-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 27 16:40:21.797649 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: spawned uWSGI worker 1 (pid: 113356, cores: 1) Jan 27 16:40:21.797649 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: spawned uWSGI worker 2 (pid: 113357, cores: 1) Jan 27 16:40:21.797649 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 27 16:40:23.596131 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:40:23.596131 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: from cryptography.utils import int_from_bytes Jan 27 16:40:23.596717 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:40:23.596717 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: from cryptography.utils import int_from_bytes Jan 27 16:40:23.600054 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:40:23.600054 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: from cryptography.utils import int_from_bytes Jan 27 16:40:23.600539 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:40:23.600539 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: from cryptography.utils import int_from_bytes Jan 27 16:40:26.207862 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:40:26.208409 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:40:26.208597 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:40:26.208957 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:40:26.209211 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:40:26.209597 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.209921 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.210242 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.210561 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.210923 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:40:26.211305 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.211389 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:40:26.211486 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.211642 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.211756 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:40:26.211911 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.212037 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:40:26.212243 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.212363 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:40:26.212508 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.212675 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.212824 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.212999 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.213149 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818830-2-iscsi {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.213320 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.213472 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.213640 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.213779 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214006 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214120 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214418 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214572 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214721 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.214920 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215046 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215246 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215351 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215602 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215873 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.215972 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216195 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216327 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216524 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818830-2-iscsi {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216641 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216852 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.216938 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217161 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217258 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217482 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217572 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217788 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.217977 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.218154 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.218370 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.218547 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.218723 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.218901 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.219078 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.219078 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.219398 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.219625 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818830-2-iscsi {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.219807 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220001 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220178 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220354 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220538 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220714 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220925 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.220925 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.221255 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.221433 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.221643 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.221794 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.221997 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222160 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222285 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222447 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222576 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222729 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222865 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.222865 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223187 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818830-2-iscsi {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223325 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223479 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223627 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223753 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.223886 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224018 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224142 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224270 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224393 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224514 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224641 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224807 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.224932 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225074 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225199 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225320 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225448 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225580 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225702 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225823 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.225943 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226065 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226196 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226326 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226449 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226645 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226773 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.226941 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227087 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227284 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227450 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227624 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227749 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.227885 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228111 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228285 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228410 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228532 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228708 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.228845 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229016 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229143 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229325 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229457 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229661 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229801 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.229970 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230235 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230366 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230489 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230619 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230742 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.230865 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231041 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231169 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231368 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231509 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231707 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.231840 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232025 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232165 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232334 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232476 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232644 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232770 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.232952 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233087 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233261 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233389 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233570 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233698 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.233878 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234005 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234198 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234326 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234515 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234650 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234836 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.234970 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235141 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235268 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235449 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235597 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235794 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.235932 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236122 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236255 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236427 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236553 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236769 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.236896 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237031 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237155 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237276 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237403 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237561 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237699 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237870 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.237997 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238175 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238303 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238482 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238784 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.238918 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239091 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239218 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239397 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239539 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239722 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.239854 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240020 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240148 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240322 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240464 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240623 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240756 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.240931 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241059 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241236 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241364 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241540 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241667 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241850 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.241984 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242156 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242289 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242458 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242591 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242763 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.242897 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243067 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243194 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243372 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243507 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243706 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.243835 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244011 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244145 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244315 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244443 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244620 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244760 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.244924 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.245052 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.245776 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.245911 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246062 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246349 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246486 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246666 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246873 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.246999 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247121 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247260 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247392 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247561 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247740 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.247903 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248032 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248210 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248410 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248544 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248675 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248797 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.248919 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249094 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249231 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249395 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249529 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249698 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.249825 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250001 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250136 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250304 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250431 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250603 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250730 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.250918 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251045 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251237 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251371 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251543 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251693 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251869 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.251990 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252176 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252301 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252487 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252627 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252795 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.252929 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.253102 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.253236 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.253407 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.253548 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.253713 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.253841 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.254019 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.254153 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.254321 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.254460 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.254630 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.254758 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.254944 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.255073 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.255255 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.255395 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.255591 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.255721 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.255923 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.256057 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.256194 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:40:26.256325 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.256525 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.256652 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.256915 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257051 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257188 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257312 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257475 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257603 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257813 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.257984 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258148 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258278 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258468 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258603 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258779 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.258914 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259092 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259217 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259455 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259630 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259799 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.259928 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.260114 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.260243 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.260427 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.260562 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.260784 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.261440 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.261777 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.261912 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.262236 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.262360 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.262553 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.262692 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.262877 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263005 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263193 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263326 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263508 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263692 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263845 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.263979 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264179 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264303 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264490 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264628 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264803 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.264946 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265137 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265264 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265454 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265590 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265772 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.265898 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266101 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266236 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266369 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266493 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266671 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266798 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.266984 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267109 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267292 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267396 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267625 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267742 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.267954 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268042 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268264 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268353 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268574 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268660 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268892 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.268977 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269205 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269294 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269515 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269601 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269820 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.269923 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270124 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270212 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270430 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270517 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270739 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.270840 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271043 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271129 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271360 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271446 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271699 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.271876 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272008 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272103 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272428 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272638 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272735 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.272945 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273040 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273252 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273338 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273562 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273656 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273865 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.273950 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274173 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274258 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274480 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274568 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274785 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.274873 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275093 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275179 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275407 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275495 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275755 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.275845 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.276075 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.276328 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.276577 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.276726 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.276922 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277086 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277292 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277443 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277590 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277727 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277863 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.277998 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278132 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278275 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278419 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278608 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278754 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.278923 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279074 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279220 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279357 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279559 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279739 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.279877 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280010 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280274 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280418 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280555 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280702 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280838 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.280982 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281126 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281262 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281406 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281543 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281678 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281823 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.281966 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282103 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282293 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282439 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282602 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282754 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.282892 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283027 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283196 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283340 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283484 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283664 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283832 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.283975 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284138 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284282 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284437 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284575 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284753 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.284898 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.285325 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.285468 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.285614 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.285752 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.285919 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286064 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286225 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286398 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286549 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286702 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286840 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.286976 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287134 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287296 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287516 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287686 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287834 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.287979 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288125 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288271 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288414 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288594 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288746 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.288882 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289024 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289171 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289338 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289481 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289649 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289793 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.289960 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290114 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290280 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290424 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290591 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290745 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.290880 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291024 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291207 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291349 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291531 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291714 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.291852 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.292505 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.292768 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.292949 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293101 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293377 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293538 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293676 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293818 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.293994 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294138 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294302 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294455 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294619 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294769 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.294907 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295054 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295222 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295379 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295548 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295739 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.295898 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296042 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296207 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296363 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296508 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296650 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.296863 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297019 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297164 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297308 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297455 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297679 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297821 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.297964 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298113 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298250 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298386 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298522 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298657 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298792 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.298962 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299106 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299247 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299397 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299533 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299700 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299853 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.299991 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300126 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300268 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300405 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300548 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300684 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300820 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.300954 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301089 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301241 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301455 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301593 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301730 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.301865 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302007 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302143 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302287 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302448 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302592 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302752 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.302896 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303059 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303222 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303382 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303526 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303711 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.303857 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304003 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304149 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304293 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304430 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304603 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304755 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.304931 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305075 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305221 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305364 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305531 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305675 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.305855 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306000 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306166 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306309 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306487 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306630 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306798 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.306943 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307088 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307223 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307390 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307533 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307840 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.307993 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.308187 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.308358 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.308592 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.308746 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.308907 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309043 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309221 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309317 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309532 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309634 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309842 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.309931 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310164 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310252 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310472 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310573 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310783 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.310871 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311091 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311177 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311392 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311489 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311722 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.311812 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312031 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312116 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312354 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312594 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312681 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.312925 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313011 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313238 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313339 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313556 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313643 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313862 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.313953 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314173 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314269 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314499 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314592 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314810 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.314896 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315120 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315213 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315423 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315515 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315753 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.315840 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316060 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316147 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316365 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316472 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316676 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.316919 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317016 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317252 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317345 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317560 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317647 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317869 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.317966 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318173 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318261 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318490 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318575 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318792 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.318891 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319096 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319208 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319408 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319495 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319731 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.319819 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320043 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320127 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320345 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320438 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320647 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320741 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.320957 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321051 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321258 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321345 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321558 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321653 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321861 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.321947 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322170 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322264 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322477 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322572 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322816 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.322898 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.323119 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.323769 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324087 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324174 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324434 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324654 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324842 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.324976 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325174 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325295 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325485 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325605 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325793 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.325933 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326099 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326247 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326409 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326556 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326751 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.326851 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327005 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327155 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327316 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327499 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327652 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327837 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.327964 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328176 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328276 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328507 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328593 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328849 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.328937 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329150 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329237 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329454 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329538 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329760 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.329857 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330063 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330175 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330365 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330452 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330672 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330767 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.330977 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331064 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331283 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331367 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331607 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331714 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.331916 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332012 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332223 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332309 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332526 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332620 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332833 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.332926 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333134 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333220 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333440 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333537 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333742 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.333826 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334042 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334127 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334351 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334437 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334656 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334742 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.334957 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335042 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335260 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335347 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335584 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335682 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335896 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.335990 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336209 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336296 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336515 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336608 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336836 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.336947 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337145 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337243 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337449 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337535 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337755 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.337851 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338059 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338140 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338364 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338451 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338665 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.338764 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.339675 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.339782 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.340278 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.340373 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.340583 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.340759 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.340893 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341108 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341195 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341422 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341509 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341732 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.341827 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342059 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342145 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342374 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342469 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342682 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342769 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.342988 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343074 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343294 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343392 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343628 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343716 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.343926 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344011 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344231 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344331 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344539 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344625 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344845 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.344939 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345147 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345242 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345450 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345536 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345757 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.345844 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346064 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346152 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346389 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346475 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346700 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.346787 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347006 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347111 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347307 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347393 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347632 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347723 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.347939 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348034 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348261 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348349 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348574 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348668 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348886 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.348982 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349208 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349294 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349522 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349617 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349836 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.349925 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350139 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350223 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350452 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350563 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350757 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.350848 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351062 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351154 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351370 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351476 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351700 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.351793 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352005 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352106 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352312 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352413 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352617 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352708 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.352929 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353021 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353238 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353338 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353538 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353849 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.353943 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354159 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354248 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354487 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354642 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354811 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.354955 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.355150 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.355429 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.355518 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.355759 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.355848 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356065 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356230 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356375 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356474 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356679 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.356764 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357009 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357094 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357306 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357398 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357617 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357703 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.357927 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358015 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358233 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358317 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358543 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358628 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358854 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.358941 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359161 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359249 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359480 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359593 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359814 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.359924 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360121 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360237 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360430 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360540 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360738 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.360837 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361047 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361134 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361353 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361450 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361720 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.361813 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362044 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362130 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362348 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362442 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362651 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362745 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.362954 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363040 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363270 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363380 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363611 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363709 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.363911 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364004 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364218 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364314 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364627 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364720 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.364936 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365035 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365249 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365354 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365559 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365646 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365864 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.365950 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366169 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366256 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366479 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366564 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366803 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.366896 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367141 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367238 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367469 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367561 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367804 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.367904 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368130 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368223 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368433 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368522 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368754 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.368848 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369069 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369155 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369374 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369462 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369698 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.369794 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.370021 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.370185 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.370488 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.370716 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.370850 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371208 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371314 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371537 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371650 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371880 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.371984 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372204 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372291 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372513 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372606 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372829 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.372927 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373135 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373222 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373448 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373547 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373753 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.373868 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374058 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374155 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374377 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374464 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374682 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374767 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.374994 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375093 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375305 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375391 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375635 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375741 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.375945 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.376219 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.376312 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.376557 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.377768 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.377867 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.377948 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378018 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378090 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378157 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378221 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378298 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378372 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378456 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378527 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378593 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378683 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378838 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.378993 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379157 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379298 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379468 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379618 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379805 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.379926 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380133 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380268 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380443 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380573 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380758 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.380893 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381070 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381223 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381385 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381553 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381695 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.381864 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382004 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382198 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382330 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382521 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382638 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382835 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.382964 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383149 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383284 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383481 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383611 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383801 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.383926 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384107 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384236 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384416 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384561 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384720 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.384871 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.385024 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.385176 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.385329 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.385481 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.385639 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.386311 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.386585 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.386892 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.386994 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.387199 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.387287 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.387521 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.387631 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.387857 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388008 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388180 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388268 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388490 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388576 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388796 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.388884 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389101 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389188 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389404 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389490 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389747 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.389836 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390052 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390139 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390384 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390470 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390698 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.390785 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391011 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391098 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391318 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391404 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391647 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391738 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.391956 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392044 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392265 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392365 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392573 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392661 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392880 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.392966 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393185 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393288 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393510 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393598 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393824 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.393910 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394147 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394243 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394453 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394545 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394758 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.394843 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395064 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395160 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395368 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395455 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395734 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.395911 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396042 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396240 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396376 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396555 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396693 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.396868 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397017 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397181 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397343 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397512 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397654 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397811 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.397980 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398107 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398297 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398418 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398610 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398726 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.398924 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399046 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399237 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399349 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399551 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399694 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.399887 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400019 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400203 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400353 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400512 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400669 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400826 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.400981 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.401141 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.401295 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.401581 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.401764 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.402294 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.402390 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.402621 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.402708 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.402930 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403019 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403247 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403334 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403606 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403698 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403908 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.403996 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404223 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404316 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404537 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404852 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.404941 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405161 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405248 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405475 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405578 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405789 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.405875 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406106 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406193 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406421 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406518 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406746 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.406832 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407062 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407147 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407379 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407473 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407717 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.407810 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408037 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408123 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408352 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408438 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408697 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.408868 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409010 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409183 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409327 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409517 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409645 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.409843 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.410217 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.410435 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.410530 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.410754 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.410841 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411073 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411160 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411398 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411493 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411747 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.411836 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412057 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412155 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412369 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412456 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412678 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412762 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.412985 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413078 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413307 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413394 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413618 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413704 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.413927 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.414022 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.414237 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.414347 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.414546 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.414623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415057 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415152 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415373 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415459 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415733 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.415824 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416061 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416159 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416384 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416483 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416702 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.416795 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.417545 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.417641 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418017 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418126 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418336 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418527 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418645 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418841 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.418962 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419157 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419275 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419473 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419593 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419811 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.419888 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420137 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420230 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420451 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420547 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420758 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.420845 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421079 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421165 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421381 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421467 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421708 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.421909 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422016 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422257 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422352 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422576 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422662 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.422907 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423000 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423209 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423303 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423514 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423844 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.423942 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424151 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424246 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424464 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424551 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424770 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.424855 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425079 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425166 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425385 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425472 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425690 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425775 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.425993 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426080 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426301 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426394 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426604 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426690 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.426948 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427035 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427241 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427348 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427506 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427613 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427846 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.427936 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428158 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428242 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428463 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428561 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428770 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.428857 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429079 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429174 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429383 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429477 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429736 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429849 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.429993 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430281 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430370 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430597 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430685 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430902 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.430989 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431212 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431305 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431517 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431663 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431853 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.431950 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.432157 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.432254 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.432468 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.432555 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.432915 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.433007 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.433377 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.433509 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.433693 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.433823 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434007 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434136 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434320 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434483 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434635 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434762 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.434948 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435090 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435260 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435406 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435589 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435745 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.435905 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436094 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436217 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436412 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436530 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436849 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.436986 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437193 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437329 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437516 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437655 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437835 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.437992 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438155 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438330 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438480 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438641 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438794 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.438952 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439105 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439260 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439417 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439643 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439747 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.439914 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440065 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440227 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440394 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440538 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440708 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.440850 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441012 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441162 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441433 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441520 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441746 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.441914 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442065 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442153 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442371 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442457 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442680 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442775 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.442989 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443074 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443304 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443392 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443638 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443740 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.443961 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444058 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444275 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444363 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444592 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444679 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444911 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.444998 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445228 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445355 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445535 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445625 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445846 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.445932 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446151 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446246 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446460 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446548 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446770 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.446870 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447086 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447180 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447391 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447481 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447743 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.447845 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.448072 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.448168 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449049 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449233 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449411 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449636 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449771 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.449955 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450099 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450284 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450424 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450615 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450744 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.450933 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451058 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451257 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451391 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451584 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451733 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.451928 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452050 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452267 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452353 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452601 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452697 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.452930 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453024 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453239 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453325 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453547 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453643 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453856 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.453943 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454169 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454255 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454493 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454581 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454813 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.454900 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455136 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455224 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455453 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455541 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455791 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.455879 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456116 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456202 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456428 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456515 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456743 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.456831 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457055 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457148 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457367 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457455 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457676 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.457762 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458035 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458137 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458309 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458395 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458625 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458711 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.458941 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459038 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459256 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459344 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459599 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459689 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.459906 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460008 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460236 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460323 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460563 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460650 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.460929 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461033 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461239 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461335 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461545 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461640 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.461790 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:40:26.461878 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.462176 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.462490 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.462823 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.463138 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.463456 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.463798 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.464215 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.464642 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.464931 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.465262 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.465592 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.465921 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.466250 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.466596 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.466911 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.467255 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.467608 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.467943 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.468246 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.468554 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:40:26.468797 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=113357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:40:26.485014 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_db.sqlalchemy.engines [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.492028 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_db.sqlalchemy.engines [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.548195 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.context [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86143b5f-d145-4abf-b204-d0c0e522ec94(cell1) {{(pid=113356) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:40:26.552451 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:40:26.554027 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:40:26.554834 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:40:26.556393 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.context [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86143b5f-d145-4abf-b204-d0c0e522ec94(cell1) {{(pid=113357) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:40:26.556831 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:40:26.561081 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_concurrency.lockutils [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:40:26.562732 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_concurrency.lockutils [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:40:26.563537 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_concurrency.lockutils [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:40:26.565514 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_concurrency.lockutils [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=113357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:40:26.567037 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_db.sqlalchemy.engines [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.571245 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_db.sqlalchemy.engines [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.578448 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_db.sqlalchemy.engines [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.581178 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_db.sqlalchemy.engines [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.732459 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_db.sqlalchemy.engines [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:26.743663 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG oslo_db.sqlalchemy.engines [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=113357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:40:27.072708 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: WARNING keystonemiddleware.auth_token [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:40:27.072933 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: WARNING keystonemiddleware.auth_token [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:40:27.079955 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: WARNING keystonemiddleware.auth_token [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:40:27.080097 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: WARNING keystonemiddleware.auth_token [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:40:27.423127 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: WARNING keystonemiddleware.auth_token [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:40:27.426331 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: WARNING keystonemiddleware.auth_token [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:40:27.428245 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: WARNING keystonemiddleware.auth_token [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:40:27.431468 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: WARNING keystonemiddleware.auth_token [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:40:27.434167 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f20318d9c0 pid: 113356 (default app) Jan 27 16:40:27.436249 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:40:27.436930 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f20318d9c0 pid: 113357 (default app) Jan 27 16:40:27.437414 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-76bb25ff-31e0-4752-a24a-ff5a649217da None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001741 Jan 27 16:40:27.437822 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Jan 27 16:40:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:41:52.695495 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:41:52.697644 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003459 Jan 27 16:41:52.703210 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:41:53.119362 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-bb64e38a-0bb6-4422-a619-bbc7ef8e62f5 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:41:53.148285 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-bb64e38a-0bb6-4422-a619-bbc7ef8e62f5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442863 Jan 27 16:41:53.149265 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jan 27 16:41:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:41:55.421664 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:41:55.422663 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-a4475f4e-b339-4a2c-b97a-e963f24953dc None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 27 16:41:55.423053 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 2/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:41:55.485970 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-13d79665-9d63-428a-aefc-90c264821aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:41:55.505989 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:41:55.505989 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:41:55.536209 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-13d79665-9d63-428a-aefc-90c264821aa0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106600 Jan 27 16:41:55.536944 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 3/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:41:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:41:55.753770 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-7a5b4d15-cbe4-43c9-b919-1b385faec1ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:41:55.756068 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:41:55.756068 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: warnings.warn(msg) Jan 27 16:41:55.806881 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-7a5b4d15-cbe4-43c9-b919-1b385faec1ea admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.261735 Jan 27 16:41:55.813534 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 3/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jan 27 16:41:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:41:58.111962 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-13d79665-9d63-428a-aefc-90c264821aa0 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:41:58.112970 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-13d79665-9d63-428a-aefc-90c264821aa0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jan 27 16:41:58.113369 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 4/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:41:58.217120 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-92771f1c-40d7-4dee-8021-89cdf82d662a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "vcpus": 1, "disk": 5, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:41:58.235202 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:41:58.235202 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: warnings.warn(msg) Jan 27 16:41:58.254510 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-92771f1c-40d7-4dee-8021-89cdf82d662a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135363 Jan 27 16:41:58.255216 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 4/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:41:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:41:58.266942 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ce7b132e-9e36-4089-9d7b-ea2bfec0bc33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:41:58.268451 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:41:58.268451 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:41:58.301584 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ce7b132e-9e36-4089-9d7b-ea2bfec0bc33 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038170 Jan 27 16:41:58.302088 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 5/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jan 27 16:41:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:00.591849 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-92771f1c-40d7-4dee-8021-89cdf82d662a admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:00.592869 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-92771f1c-40d7-4dee-8021-89cdf82d662a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jan 27 16:42:00.593278 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:00.654835 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-64ea8de8-1221-47ec-94f1-ba7d076a7984 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:00.674549 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-64ea8de8-1221-47ec-94f1-ba7d076a7984 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075228 Jan 27 16:42:00.675243 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 6/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:00.687658 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-f54b9c32-a251-405b-966d-a6a6bd4df350 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:00.712955 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-f54b9c32-a251-405b-966d-a6a6bd4df350 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028912 Jan 27 16:42:00.714281 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 6/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jan 27 16:42:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:03.061538 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-64ea8de8-1221-47ec-94f1-ba7d076a7984 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:03.062550 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-64ea8de8-1221-47ec-94f1-ba7d076a7984 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 27 16:42:03.062956 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 7/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:03.125672 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-bf566e36-cb16-4572-a5c4-a325c37d5c70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "id": "d3"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:03.144973 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-bf566e36-cb16-4572-a5c4-a325c37d5c70 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074924 Jan 27 16:42:03.144973 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 7/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:42:03.157375 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-01d40948-140d-4678-a740-94fec1678c1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:03.186473 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-01d40948-140d-4678-a740-94fec1678c1a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031951 Jan 27 16:42:03.187074 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 8/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jan 27 16:42:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:05.505729 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-bf566e36-cb16-4572-a5c4-a325c37d5c70 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:05.507313 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-bf566e36-cb16-4572-a5c4-a325c37d5c70 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jan 27 16:42:05.507944 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 8/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:05.574062 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:05.594372 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080260 Jan 27 16:42:05.602987 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 9/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:05.608393 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-4c4e6629-ae81-46d4-93e7-8a8e2f68f06a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:05.633474 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-4c4e6629-ae81-46d4-93e7-8a8e2f68f06a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028575 Jan 27 16:42:05.642936 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 9/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu Jan 27 16:42:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:07.908170 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:07.909172 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jan 27 16:42:07.909576 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 10/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:07.972151 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-437abb3d-3c28-4a75-9454-749a972b9b68 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:07.996538 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-437abb3d-3c28-4a75-9454-749a972b9b68 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079952 Jan 27 16:42:07.997253 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 10/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jan 27 16:42:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:10.379806 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:10.380881 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-608657e9-00ca-4686-bd0b-7ef7288cc4c3 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jan 27 16:42:10.381515 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 11/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:42:10.442557 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-73e31a77-9661-434f-b6d1-f39b9b88dc46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "swap": 0, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:10.462394 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-73e31a77-9661-434f-b6d1-f39b9b88dc46 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074980 Jan 27 16:42:10.463040 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 11/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:42:10.474357 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-d032e425-5aac-49ac-a568-b8e959c03b8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:10.500815 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-d032e425-5aac-49ac-a568-b8e959c03b8c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029934 Jan 27 16:42:10.501432 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 12/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jan 27 16:42:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:12.755376 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-73e31a77-9661-434f-b6d1-f39b9b88dc46 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:12.757066 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-73e31a77-9661-434f-b6d1-f39b9b88dc46 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Jan 27 16:42:12.757628 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:12.818937 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-c3bac7cd-82cd-4a25-a557-bcf50234f230 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:12.838400 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-c3bac7cd-82cd-4a25-a557-bcf50234f230 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074690 Jan 27 16:42:12.839272 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 13/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:12.851383 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-98a57100-f6ca-4784-a0da-b1c40f66c2e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:12.874510 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-98a57100-f6ca-4784-a0da-b1c40f66c2e3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027344 Jan 27 16:42:12.875657 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 13/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jan 27 16:42:12 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:15.164681 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-c3bac7cd-82cd-4a25-a557-bcf50234f230 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:15.165797 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-c3bac7cd-82cd-4a25-a557-bcf50234f230 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jan 27 16:42:15.166283 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 14/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:15.223036 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-654a4162-e429-44df-963b-27e885cecb89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:15.241607 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-654a4162-e429-44df-963b-27e885cecb89 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.069440 Jan 27 16:42:15.242161 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 14/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:15.253583 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-fa77df7d-ac11-4e01-b757-23dc724d3285 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:15.278071 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-fa77df7d-ac11-4e01-b757-23dc724d3285 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028074 Jan 27 16:42:15.278647 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 15/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jan 27 16:42:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:17.574371 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-654a4162-e429-44df-963b-27e885cecb89 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:17.575410 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-654a4162-e429-44df-963b-27e885cecb89 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jan 27 16:42:17.575871 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 15/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:42:17.634452 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-2663f76e-e029-47ac-9450-4fcf2f0a62ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:17.657416 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-2663f76e-e029-47ac-9450-4fcf2f0a62ae admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075618 Jan 27 16:42:17.658124 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 16/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:17.670087 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-5ac1712c-a4cb-4212-a3aa-19c09b405974 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:17.698439 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-5ac1712c-a4cb-4212-a3aa-19c09b405974 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031955 Jan 27 16:42:17.699063 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 16/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jan 27 16:42:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:19.984051 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-2663f76e-e029-47ac-9450-4fcf2f0a62ae admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:19.985049 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-2663f76e-e029-47ac-9450-4fcf2f0a62ae admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jan 27 16:42:19.985446 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 17/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:20.050281 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:20.069349 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077722 Jan 27 16:42:20.070048 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 17/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu Jan 27 16:42:19 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:42:20.081392 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-0e171cde-9c98-41cb-9a8f-10b6e4d6f86a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:20.105710 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-0e171cde-9c98-41cb-9a8f-10b6e4d6f86a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027877 Jan 27 16:42:20.106594 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 18/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu Jan 27 16:42:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:42:42.854558 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:42.855542 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jan 27 16:42:42.855974 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:42:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:42.913606 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-d17df73b-062e-42b9-9fa1-c9b1b7ab60b3 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:42.930403 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-d17df73b-062e-42b9-9fa1-c9b1b7ab60b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068336 Jan 27 16:42:42.930937 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jan 27 16:42:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:44.298979 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:44.300000 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-66633553-c8e5-4ec9-9ac8-f293922ebc81 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jan 27 16:42:44.300396 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 19/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:44.493212 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-c269aba0-f9a5-41be-a194-7ce760d057eb admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:44.498648 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.wsgi [None req-c269aba0-f9a5-41be-a194-7ce760d057eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 27 16:42:44.499212 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-c269aba0-f9a5-41be-a194-7ce760d057eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:44.500038 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-c269aba0-f9a5-41be-a194-7ce760d057eb admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058691 Jan 27 16:42:44.500554 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 20/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jan 27 16:42:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:44.510490 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-25662553-725a-4d00-b6a8-e63a593f8345 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:44.531200 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-25662553-725a-4d00-b6a8-e63a593f8345 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024207 Jan 27 16:42:44.531764 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 20/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:44.541694 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-b903c5e9-8c46-4e85-884e-d748f58fcaa9 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:44.562714 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-b903c5e9-8c46-4e85-884e-d748f58fcaa9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024463 Jan 27 16:42:44.563256 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 21/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:42:44.573242 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-bd7fed19-5e3f-424c-84ae-13a794ce3a5c admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:44.578712 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.wsgi [None req-bd7fed19-5e3f-424c-84ae-13a794ce3a5c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 27 16:42:44.579275 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-bd7fed19-5e3f-424c-84ae-13a794ce3a5c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=113357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:44.580098 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-bd7fed19-5e3f-424c-84ae-13a794ce3a5c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010504 Jan 27 16:42:44.580590 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 21/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jan 27 16:42:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jan 27 16:42:45.841300 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-b903c5e9-8c46-4e85-884e-d748f58fcaa9 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:45.842299 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-b903c5e9-8c46-4e85-884e-d748f58fcaa9 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jan 27 16:42:45.842689 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 22/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:46.042559 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-79d8e221-7238-48c8-8303-5333319df615 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:46.048538 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.wsgi [None req-79d8e221-7238-48c8-8303-5333319df615 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 27 16:42:46.049157 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-79d8e221-7238-48c8-8303-5333319df615 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:46.049999 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-79d8e221-7238-48c8-8303-5333319df615 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057807 Jan 27 16:42:46.050445 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 22/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jan 27 16:42:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:46.059872 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-8f5eebe0-950c-40ad-ba8f-c907b382a79e admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:46.073720 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-8f5eebe0-950c-40ad-ba8f-c907b382a79e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017315 Jan 27 16:42:46.074248 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 23/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:46.084102 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-657f57e6-a93f-463f-b044-e5ddfe76a293 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:46.097336 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-657f57e6-a93f-463f-b044-e5ddfe76a293 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017518 Jan 27 16:42:46.097907 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 23/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:42:46.106627 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-dba6939b-5a07-4d89-b7f3-88a631922efc admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:46.111752 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.wsgi [None req-dba6939b-5a07-4d89-b7f3-88a631922efc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 27 16:42:46.112307 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-dba6939b-5a07-4d89-b7f3-88a631922efc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=113356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:46.113071 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-dba6939b-5a07-4d89-b7f3-88a631922efc admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009837 Jan 27 16:42:46.113607 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 24/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Jan 27 16:42:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:47.420793 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-657f57e6-a93f-463f-b044-e5ddfe76a293 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:47.421793 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-657f57e6-a93f-463f-b044-e5ddfe76a293 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Jan 27 16:42:47.422190 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 24/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:47.613897 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-0a557b40-ae01-4f92-9763-2871bdabb7b4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:47.619061 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.wsgi [None req-0a557b40-ae01-4f92-9763-2871bdabb7b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 27 16:42:47.619650 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-0a557b40-ae01-4f92-9763-2871bdabb7b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:47.620434 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-0a557b40-ae01-4f92-9763-2871bdabb7b4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057281 Jan 27 16:42:47.620937 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 25/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:42:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:47.631247 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-16777125-0fd1-4ae7-bbc2-943b02724996 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:47.645848 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-16777125-0fd1-4ae7-bbc2-943b02724996 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017781 Jan 27 16:42:47.646766 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 25/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:47.656970 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:47.672997 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020320 Jan 27 16:42:47.673742 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 26/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Jan 27 16:42:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:42:47.684132 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-419c6bf2-b758-473d-8ff7-64483cbe1db1 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:47.689310 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.wsgi [None req-419c6bf2-b758-473d-8ff7-64483cbe1db1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 27 16:42:47.689860 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-419c6bf2-b758-473d-8ff7-64483cbe1db1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=113357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:42:47.690623 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-419c6bf2-b758-473d-8ff7-64483cbe1db1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010092 Jan 27 16:42:47.691108 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 26/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:42:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:48.968460 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:48.969449 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jan 27 16:42:48.969838 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:49.162062 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-0e3b2e5c-4273-492f-ba1a-09557c77c9f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:49.181408 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-0e3b2e5c-4273-492f-ba1a-09557c77c9f0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070280 Jan 27 16:42:49.181880 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jan 27 16:42:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:50.475367 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:50.476399 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jan 27 16:42:50.476796 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:50.668289 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-cfdb2c4b-76e1-41b7-8f47-70c1839bc93a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:50.686172 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-cfdb2c4b-76e1-41b7-8f47-70c1839bc93a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068446 Jan 27 16:42:50.686674 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 28/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jan 27 16:42:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:51.970936 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:51.971966 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jan 27 16:42:51.972410 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 29/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:52.167549 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-d7c5bf8f-1f5d-410d-8e32-f2f0917cc579 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:52.186099 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-d7c5bf8f-1f5d-410d-8e32-f2f0917cc579 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069607 Jan 27 16:42:52.186566 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 29/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jan 27 16:42:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:42:53.467578 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:53.468618 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jan 27 16:42:53.469008 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 30/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:53.663325 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-62b6adf3-565c-47fa-93ad-cf72d554936f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:42:53.681355 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-62b6adf3-565c-47fa-93ad-cf72d554936f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071049 Jan 27 16:42:53.681834 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 30/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Jan 27 16:42:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:42:54.959373 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:54.960394 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jan 27 16:42:54.960788 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 31/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:42:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:42:55.151676 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-027c28d7-f2d0-4f71-ad93-3ea66e7b4544 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:42:55.171285 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-027c28d7-f2d0-4f71-ad93-3ea66e7b4544 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070345 Jan 27 16:42:55.171753 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 31/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Jan 27 16:42:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:43:41.029156 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.030400 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-ee108e8d-8450-4d10-85f9-115b5cc76ec4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jan 27 16:43:41.030802 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:43:41.087109 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-fdc8220c-782f-4ff9-a319-502bfa3e0973 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.107019 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-fdc8220c-782f-4ff9-a319-502bfa3e0973 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070404 Jan 27 16:43:41.107643 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 32/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:43:41.129128 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-90addb21-4f7f-494a-8093-57f3cac628ba admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.136664 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-90addb21-4f7f-494a-8093-57f3cac628ba admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011076 Jan 27 16:43:41.137177 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 33/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:43:41.148768 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-71ef0c4f-1aaa-494b-9707-e91a3416104b admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.156602 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-71ef0c4f-1aaa-494b-9707-e91a3416104b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011292 Jan 27 16:43:41.157116 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 33/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:43:41.168555 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-7247ef75-05b4-44ac-8448-ef121b794d6b admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.176303 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-7247ef75-05b4-44ac-8448-ef121b794d6b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011178 Jan 27 16:43:41.176822 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 34/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:43:41.187383 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:43:41.194849 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010785 Jan 27 16:43:41.195360 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 34/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu Jan 27 16:43:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:45:09.555750 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-dd15b5ba-938d-4001-9800-2639a10b7161 tempest-verify_tempest_config-1568701573 tempest-verify_tempest_config-1568701573-project] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:45:09.557754 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-dd15b5ba-938d-4001-9800-2639a10b7161 tempest-verify_tempest_config-1568701573 tempest-verify_tempest_config-1568701573-project] 10.222.0.48 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104397 Jan 27 16:45:09.558277 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1133 bytes} [Thu Jan 27 16:45:09 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:46:42.628178 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:42.629288 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jan 27 16:46:42.629687 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 35/70] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:46:42.888680 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:42.890607 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:46:42.890607 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:46:42.892169 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:42.892615 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:42.893494 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:42.893918 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:42.928755 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-2e9e43f1-dfd1-464a-ab4b-3932e696b641 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154809 Jan 27 16:46:42.929308 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 36/71] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:46:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:46:44.225066 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:44.226052 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001396 Jan 27 16:46:44.226442 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:46:44.421861 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:44.423111 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:46:44.423111 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:46:44.424675 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:44.425148 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:44.425945 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:44.426372 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:44.445128 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-270ebed9-23d0-4625-b68d-751b7020f289 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075074 Jan 27 16:46:44.445602 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 37/73] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:46:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:46:56.165474 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:56.166472 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jan 27 16:46:56.166865 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:46:56.364304 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:56.365459 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:46:56.365459 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:46:56.366961 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:56.367394 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:56.368210 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:56.368640 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:56.393629 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-9c77088a-f614-471c-a49d-114051dd6c13 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079454 Jan 27 16:46:56.394097 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 38/75] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:46:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:46:57.673985 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: DEBUG nova.api.openstack.wsgi [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] Calling method '>' {{(pid=113357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:57.674984 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: INFO nova.api.openstack.requestlog [None req-ba46e4d0-5d67-471a-8673-8e497cbd77f7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jan 27 16:46:57.675416 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: [pid: 113357|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Jan 27 16:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:46:57.868948 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG nova.api.openstack.wsgi [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] Calling method '>' {{(pid=113356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:46:57.870128 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:46:57.870128 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: warnings.warn(msg) Jan 27 16:46:57.871704 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:57.872144 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:57.872974 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:46:57.873415 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: DEBUG oslo_concurrency.lockutils [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=113356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:46:57.898885 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: INFO nova.api.openstack.requestlog [None req-24669622-60a0-4530-96c8-3bfcd93273c9 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080388 Jan 27 16:46:57.899446 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: [pid: 113356|app: 0|req: 39/77] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Jan 27 16:46:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:47:58.485033 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: Thu Jan 27 16:47:58 2022 - graceful shutdown triggered... Jan 27 16:47:58.484765 dv-cinder-818830-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 27 16:47:58.485993 dv-cinder-818830-2-iscsi devstack@n-api.service[113357]: Gracefully killing worker 2 (pid: 113357)... Jan 27 16:47:58.486353 dv-cinder-818830-2-iscsi devstack@n-api.service[113356]: Gracefully killing worker 1 (pid: 113356)... Jan 27 16:47:59.485797 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: worker 1 buried after 1 seconds Jan 27 16:47:59.486304 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: worker 2 buried after 1 seconds Jan 27 16:47:59.486304 dv-cinder-818830-2-iscsi devstack@n-api.service[113355]: goodbye to uWSGI. Jan 27 16:47:59.487452 dv-cinder-818830-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 27 16:47:59.488018 dv-cinder-818830-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 27 16:47:59.490827 dv-cinder-818830-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 27 16:47:59.500475 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 27 16:47:59.503066 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jan 27 16:47:59 2022] *** Jan 27 16:47:59.503219 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 27 16:47:59.503362 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 27 16:47:59.503475 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: nodename: dv-cinder-818830-2-iscsi Jan 27 16:47:59.503604 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: machine: x86_64 Jan 27 16:47:59.503708 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: clock source: unix Jan 27 16:47:59.503809 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: pcre jit disabled Jan 27 16:47:59.503924 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: detected number of CPU cores: 4 Jan 27 16:47:59.504037 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: current working directory: / Jan 27 16:47:59.504146 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: detected binary path: /usr/bin/uwsgi-core Jan 27 16:47:59.504259 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: your processes number limit is 47680 Jan 27 16:47:59.504390 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: your memory page size is 4096 bytes Jan 27 16:47:59.504501 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: detected max file descriptor number: 2048 Jan 27 16:47:59.504611 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: lock engine: pthread robust mutexes Jan 27 16:47:59.504888 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: thunder lock: enabled Jan 27 16:47:59.505181 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 27 16:47:59.505376 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 27 16:47:59.551092 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: Python main interpreter initialized at 0x5623f61689c0 Jan 27 16:47:59.551092 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: python threads support enabled Jan 27 16:47:59.551092 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: your server socket listen backlog is limited to 100 connections Jan 27 16:47:59.551092 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: your mercy for graceful operations on workers is 90 seconds Jan 27 16:47:59.551484 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: mapped 403077 bytes (393 KB) for 2 cores Jan 27 16:47:59.551586 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: *** Operational MODE: preforking *** Jan 27 16:47:59.551818 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: *** uWSGI is running in multiple interpreter mode *** Jan 27 16:47:59.551818 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: spawned uWSGI master process (pid: 127782) Jan 27 16:47:59.552024 dv-cinder-818830-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 27 16:47:59.552615 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: spawned uWSGI worker 1 (pid: 127795, cores: 1) Jan 27 16:47:59.552971 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: spawned uWSGI worker 2 (pid: 127796, cores: 1) Jan 27 16:47:59.553128 dv-cinder-818830-2-iscsi devstack@n-api.service[127782]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 27 16:48:01.533123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:48:01.533123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: from cryptography.utils import int_from_bytes Jan 27 16:48:01.533771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:48:01.533771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: from cryptography.utils import int_from_bytes Jan 27 16:48:01.547395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:48:01.547395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: from cryptography.utils import int_from_bytes Jan 27 16:48:01.548061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:48:01.548061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: from cryptography.utils import int_from_bytes Jan 27 16:48:03.980029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:48:03.980565 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:48:03.980832 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:48:03.981079 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:48:03.981349 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:48:03.981739 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.982072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.982481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.983432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.983801 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.984129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.984463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.984791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.985128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.985398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.985722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.986052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818830-2-iscsi {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.986380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.986700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.987020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.987345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.987681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.988016 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.988331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.988843 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.990237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.990237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.990237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.990633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.990868 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.991190 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.991509 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.991858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.992201 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.992508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.992922 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818830-2-iscsi {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.993247 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.993586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.993892 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.994319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.994642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.994965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.995284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.995642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.995968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.996294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.996627 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.996954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.997283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.997593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.997937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.998302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.998629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.998944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.999257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.999515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:03.999860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.000189 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.000522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.000854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.001112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.001370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.001698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.002025 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.002340 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.002652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.002971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.003284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.003623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.003943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.004258 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.004575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.004897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.005226 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.005553 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.005868 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.006198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.006606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.006862 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.007185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.007528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.007887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.008207 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.008535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.008864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.009180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.009492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.009808 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.010133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.010474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.010786 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.011042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.011351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.011692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.012021 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.012335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.012649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.012956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.013274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.013612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.014087 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.014548 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.014872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.015194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.015504 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.015852 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.016168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.016494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.016816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.017144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.017462 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.017778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.018094 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.018410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.018740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.019058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.019372 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.019728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.020046 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.020358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.020684 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.021000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.021314 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.021640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.022085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.022249 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.022573 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.022893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.023203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.023548 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.023851 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.024165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.024478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.024791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.025108 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.025413 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.025739 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.026066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.026385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.026987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.027293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.027620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.027969 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.028128 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:48:04.028625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:48:04.028781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.028781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.029078 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:48:04.029735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.029895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:48:04.030042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.030196 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:48:04.030355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.030500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.030651 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.030796 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.030963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.031119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.031272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.031425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.031620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.031783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.031937 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.032097 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.032333 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.032491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.032762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.032914 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.033068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.033234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.033379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.033554 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.033844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.034007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.034188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.034413 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.034564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-818830-2-iscsi {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.034717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.034869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.035015 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.035943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.036128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.036278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.036423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.036580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.036757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.037013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.037707 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.037798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.037872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.037954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.038026 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.038208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.038411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.038636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038730 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.038825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.038913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.039102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.039276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.039449 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039544 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.039668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039749 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.039830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.039908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.040108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.040201 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.040524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.040623 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-818830-2-iscsi {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.040837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.040943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.041151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.041258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.041464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.041568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.041782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.041886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.042096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.042192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.042422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.042583 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.042755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.042904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.043066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.043217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.043393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.043549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.043733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.043885 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.044028 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.044168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.044341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.044497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.044641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.044820 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.045035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.045786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.045943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.046128 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.046284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.046439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.046580 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.046776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.046933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.047083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.047238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.047387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.047549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.047728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.047870 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.048027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.048180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.048321 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.048472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.048620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.048768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.048991 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.049171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.049315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.049457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.049608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.049759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.049909 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.050058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.050201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.050350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.050498 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.050639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.050791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.050932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.051422 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.051597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.051757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.051911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.052062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.052211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.052360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.052510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.052651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.052801 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.052951 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.053099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.053240 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.053381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.053521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.053694 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.053849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.053997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.054154 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.054296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.054437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.054590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.054732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.054873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.055023 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.055178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.055330 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.055486 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.055683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.055838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.055988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.056144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.056295 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.056437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.056587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.056728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.056875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.057030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.057181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.057331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.057492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.057635 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.057784 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.057926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.058067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.058221 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.058363 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.058504 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.058646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.058793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.058935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.059103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.059331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.059495 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.059687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.059840 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.059982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.060135 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.060278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.060444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.060650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.060794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.060935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.061087 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.061229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.061369 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.061527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.061679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.061829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.061980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.062129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.062271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.062419 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.062561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.062710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.062860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.063000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.063140 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.063287 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.063445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.063612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.063773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.063924 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.064073 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.064240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.064398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.064618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.064762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.064903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.065043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.065191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.065351 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.065511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.065662 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.065803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.065945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.066109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.066275 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.066431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.066579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.066728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.066870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.067018 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.067175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.067334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.067484 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.067704 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.067853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.068002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.068151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.068299 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.068441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.068589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.068731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.068879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.069029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.069208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.069471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.069621 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.069771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.069911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.070060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.070202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.070356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.070505 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.070647 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.070795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.070937 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.071085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.071237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.071391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.071532 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.071765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.071907 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.072060 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.072211 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.072360 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.072509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.072650 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.072790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.072944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.073085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.073225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.073383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.073524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.073665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.073819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.073961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.074109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.074251 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.074392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.074532 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:48:04.074714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.074911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075365 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075516 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.075989 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.076775 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.076938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077780 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.077944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078705 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.078860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079307 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079466 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.079883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080194 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.080935 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.081977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082396 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082701 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.082988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.083190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.083347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.083548 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.083667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.083942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.084261 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.084579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.084898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.085228 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.085543 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.085862 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.086179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.086489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.086813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.087133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.087759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.088884 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089210 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089378 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.089853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090671 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.090983 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.091145 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.091312 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.091474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.091685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.091900 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092673 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.092986 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.093148 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.093907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.093907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.094223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.094377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.094588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.094752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.094916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.095078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.095253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.096357 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.096530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.096686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.096839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097322 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097477 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.097947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.098913 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099216 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099733 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.099896 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100364 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.100834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.101865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102026 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.102995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.103147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.103371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.103371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.104401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.104558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.104712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.104865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105347 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.105964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.106894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.107792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.107986 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.108142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.108302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.108454 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.108606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.108767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.109257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.109432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.109587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.109740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.109891 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110233 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110631 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.110935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.111772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112079 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.112870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.113022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.113174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.113174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.113471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.113471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.114430 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.114597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.114759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.114920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115744 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.115906 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.116060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.116220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.116456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.116702 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.117870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.118853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119316 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119684 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.119993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120475 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.120927 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.121861 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122012 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122176 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122659 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.122912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.123109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.123273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.123425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.123826 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.124577 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.124744 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.124921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125236 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125560 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.125886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126047 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126669 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.126903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.127057 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.127227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.127489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.127679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.127869 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128182 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128645 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.128970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.129130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.129354 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.129508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.129659 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.129835 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130510 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130821 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.130975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131285 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131444 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131628 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.131960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132145 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132499 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.132974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.133903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.134086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.134838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135173 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.135917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136569 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.136893 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137056 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137210 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137362 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.137842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.138004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.138156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.138156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.138452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.139367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.139553 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.139763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.139926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140555 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.140860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141555 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141721 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.141874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142827 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.142987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.143146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.143306 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.143475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.143664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.143843 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.144004 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.144155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.144338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145479 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.145807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146105 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146575 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.146898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147050 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147212 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147363 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147716 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.147879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.148958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.149919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.150874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.151025 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.151175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.151342 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.151505 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152339 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152506 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.152829 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153716 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.153876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.154028 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.154258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.154465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155459 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.155963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.156922 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157708 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.157868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.158020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.158228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.158395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.158628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.160772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.161932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.162116 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.162278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.162436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.162608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.162928 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.163945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.164107 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.164323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.164486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.164649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.165274 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.165464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.165816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.165979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166301 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166616 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166814 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.166980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.167165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.167322 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.167446 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.167561 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168685 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.168838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.169041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.169041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.169347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.169508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.169661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.170400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.170647 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.170850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171418 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171607 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.171968 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.172158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.172324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.172498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.172670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.172860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.173129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.173355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.173534 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.173698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.173852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.174843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.175595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.175777 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176260 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176446 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176851 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.176851 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177307 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.177995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.179383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.179383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.179383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.179383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.179383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.180161 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.180323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.180323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.180668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.180865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181031 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.181902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.182198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.182350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.182509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.182687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.182910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.183911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184218 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184218 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.184841 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.185028 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.185685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.185849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186065 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.186810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187304 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187650 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.187960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.188792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.189774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.190890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191896 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.191896 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.192203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.192390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.192557 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.192718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.192872 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193428 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193616 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.193931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194092 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194560 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.194960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.195112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.195767 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.195952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.196108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.196272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.196562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.196722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.196892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197047 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197662 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.197993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198761 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.198914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199226 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.199946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200261 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.200954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.201688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.201869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202365 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202527 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.202999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.203155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.203332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.203520 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.203763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.203929 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204233 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.204921 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.205083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.205083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.205411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.205986 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.206149 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.206302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.206484 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.206742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.206902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207215 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207768 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.207931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.208105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.208258 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.208761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.208930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209635 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.209954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210307 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.210973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.211134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.211296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.211449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.211660 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.211828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212023 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212192 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212662 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.212837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213615 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213776 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.213930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214240 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.214723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.215032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.215032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.215348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.215500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.216104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.216282 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.216444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.216605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217184 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.217997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.218966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.219129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.219290 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.219451 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.219701 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.219861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220495 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220689 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.220994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221525 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.221847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.222295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.222449 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.222599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.222757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.222923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223075 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.223951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.224777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.225239 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.225393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.225544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.225705 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.226285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.226465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.226620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.226774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.226926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.227255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.227536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.227795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.227964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228118 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228435 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.228929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.229869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.230894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231047 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.231935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.232102 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.232790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.232996 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233484 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.233978 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234784 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.234937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.235096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.235096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.235415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.235716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.235910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.236497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.236675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.236839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237591 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.237905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238242 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238405 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238559 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.238874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.239280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.239454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.239627 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.239787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.239940 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.240937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241264 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241800 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.241961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242289 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.242936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.243099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.243265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.243427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.243626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.243797 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244522 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.244846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245316 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245793 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.245954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.246106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.246106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.246804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.246804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.247120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.247120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.247458 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.247737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.247953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.248764 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.248930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249790 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.249953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250290 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.250930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.251092 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.251245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.251405 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.251604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.251782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252019 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252019 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.252945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.253151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.253320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.253482 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.253636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.253913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.254086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.254470 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.254626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.254817 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.254971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.255139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.255330 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.255489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.255670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.255831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.256025 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.256234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.256390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.256917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257713 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.257921 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258012 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127795) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.258807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.259917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.260886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.261966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.263164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.264584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.265831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.267488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.268701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.268701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.268701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.268701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.268701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269683 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_db.sqlalchemy.engines [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.269861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.271046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.272332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.273625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.274851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.275802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.275802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.275802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.276278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.276278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.276604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.277384 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.277591 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.277800 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.278143 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.278477 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.278805 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.279115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.279452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.279963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.280137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.280467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.280802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.281121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.281446 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.281760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.282086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.282400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.282724 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.283050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.283372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.283710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.284046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.284362 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.284678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.284995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.285308 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.285619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.285931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.286262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.286664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.286975 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.287524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.287727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.287957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.288278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.288594 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.288926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.289240 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.289560 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.289947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.290182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.290503 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.290822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.291149 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.291475 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.291827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.292157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.292507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.292824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.293171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.293502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.293817 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.294131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.294439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:48:04.294685 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127796) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:48:04.319013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_db.sqlalchemy.engines [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.328863 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.context [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86143b5f-d145-4abf-b204-d0c0e522ec94(cell1) {{(pid=127795) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:48:04.333181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:04.334789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:04.335636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:04.337552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:04.348443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_db.sqlalchemy.engines [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.350427 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_db.sqlalchemy.engines [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.383752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.context [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),86143b5f-d145-4abf-b204-d0c0e522ec94(cell1) {{(pid=127796) load_cells /opt/stack/nova/nova/context.py:464}} Jan 27 16:48:04.388042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:04.390227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:04.391059 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:04.393112 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:04.405267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_db.sqlalchemy.engines [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.407147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_db.sqlalchemy.engines [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.517784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_db.sqlalchemy.engines [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127795) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.570169 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_db.sqlalchemy.engines [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127796) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:48:04.839055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: WARNING keystonemiddleware.auth_token [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:48:04.845786 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: WARNING keystonemiddleware.auth_token [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:48:04.893740 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: WARNING keystonemiddleware.auth_token [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:48:04.900743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: WARNING keystonemiddleware.auth_token [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:48:05.190076 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: WARNING keystonemiddleware.auth_token [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:48:05.195329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: WARNING keystonemiddleware.auth_token [None req-aab0c038-7013-4bd0-9f37-dcaea8d32c06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:48:05.200453 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623f61689c0 pid: 127795 (default app) Jan 27 16:48:05.243091 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: WARNING keystonemiddleware.auth_token [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 27 16:48:05.248904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: WARNING keystonemiddleware.auth_token [None req-7b128701-5a93-49e5-8b3d-590e993a0046 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 27 16:48:05.254188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623f61689c0 pid: 127796 (default app) Jan 27 16:48:40.905881 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-baf3cd80-5887-41e7-95d3-abae86eda0ec tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Action: 'create', calling method: .version_select at 0x7f0cf243eca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1694337436", "metadata": {"Type": "work"}}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:40.918816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-baf3cd80-5887-41e7-95d3-abae86eda0ec tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:40.920035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-baf3cd80-5887-41e7-95d3-abae86eda0ec tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.481491 Jan 27 16:48:40.920925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:48:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1484 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:48:40.970935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e0971ffe-cac1-47b9-abcc-6fe12ad0160e tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Action: 'create', calling method: .version_select at 0x7f0cf243eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1124921938", "metadata": {"Type": "work"}}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:41.055364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-351015713", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "59590692-d01e-44a9-bec5-15417e45095c"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:41.561471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] validate_networks() for [('59590692-d01e-44a9-bec5-15417e45095c', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:48:41.746070 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e0971ffe-cac1-47b9-abcc-6fe12ad0160e tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.464712 Jan 27 16:48:41.747450 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:48:40 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1469 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 27 16:48:41.760630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9f384a92-135d-4f99-9a15-926597f702dc tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Action: 'create', calling method: .version_select at 0x7f0cf232f820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-210943898", "metadata": {"Type": "work"}}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:41.763954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9f384a92-135d-4f99-9a15-926597f702dc tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:41.766513 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9f384a92-135d-4f99-9a15-926597f702dc tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016006 Jan 27 16:48:41.768118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:48:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:48:41.779293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d51e3d20-db9c-4dc6-b899-fb25d658152b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf2c243a0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:41.859874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d51e3d20-db9c-4dc6-b899-fb25d658152b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 200 len: 353 microversion: 2.1 time: 0.089494 Jan 27 16:48:41.860726 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:41 2022] GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:41.870551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9b27b080-bcdb-4e29-b402-88864cab9998 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Action: 'create', calling method: .version_select at 0x7f0cf22a00d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1119507417", "metadata": {"Type": "work"}}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:41.872731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9b27b080-bcdb-4e29-b402-88864cab9998 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:41.873761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9b27b080-bcdb-4e29-b402-88864cab9998 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011907 Jan 27 16:48:41.874727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 4/5] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:48:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:48:41.889562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3d1f06a2-e780-4f88-be48-660274f88e70 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Calling method '.version_select at 0x7f0cf22a0ca0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:41.928798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-3d1f06a2-e780-4f88-be48-660274f88e70 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] HTTP exception thrown: Volume tempest-invalid-1720971783 could not be found. Jan 27 16:48:41.929161 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3d1f06a2-e780-4f88-be48-660274f88e70 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 404 to user: Volume tempest-invalid-1720971783 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:41.929993 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3d1f06a2-e780-4f88-be48-660274f88e70 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1720971783" status: 404 len: 99 microversion: 2.1 time: 0.050263 Jan 27 16:48:41.930738 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 5/6] 10.222.0.48 () {58 vars in 1217 bytes} [Thu Jan 27 16:48:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1720971783 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 27 16:48:41.941988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-14d08993-f718-456e-9d02-adae08faad45 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004429 Jan 27 16:48:41.943861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 6/7] 10.222.0.48 () {58 vars in 1139 bytes} [Thu Jan 27 16:48:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 27 16:48:41.956596 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b52ae803-dd3e-42fe-8af2-1e4a4542784c tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007091 Jan 27 16:48:41.958527 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 7/8] 10.222.0.48 () {58 vars in 1136 bytes} [Thu Jan 27 16:48:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 27 16:48:41.969711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-86e22bcc-1986-43a1-aea3-ff086405983f tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Calling method '.version_select at 0x7f0cf22a01f0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:42.009325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-86e22bcc-1986-43a1-aea3-ff086405983f tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] HTTP exception thrown: Volume 5070f992-074f-4e51-bb66-d6a7babaae4c could not be found. Jan 27 16:48:42.010571 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-86e22bcc-1986-43a1-aea3-ff086405983f tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 404 to user: Volume 5070f992-074f-4e51-bb66-d6a7babaae4c could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:42.011589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-86e22bcc-1986-43a1-aea3-ff086405983f tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/5070f992-074f-4e51-bb66-d6a7babaae4c" status: 404 len: 109 microversion: 2.1 time: 0.047009 Jan 27 16:48:42.012689 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 8/9] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:48:41 2022] DELETE /compute/v2.1/os-volumes/5070f992-074f-4e51-bb66-d6a7babaae4c => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:48:42.023813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b80c4371-01bf-4caf-8934-a95fb35cc2a1 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Calling method '.version_select at 0x7f0cf22a0e50>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:42.064395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-b80c4371-01bf-4caf-8934-a95fb35cc2a1 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] HTTP exception thrown: Volume f1816a53-701e-4030-b511-771672c65613 could not be found. Jan 27 16:48:42.065318 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b80c4371-01bf-4caf-8934-a95fb35cc2a1 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] Returning 404 to user: Volume f1816a53-701e-4030-b511-771672c65613 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:42.066600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b80c4371-01bf-4caf-8934-a95fb35cc2a1 tempest-VolumesNegativeTest-820629179 tempest-VolumesNegativeTest-820629179-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/f1816a53-701e-4030-b511-771672c65613" status: 404 len: 109 microversion: 2.1 time: 0.046731 Jan 27 16:48:42.067721 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:42 2022] GET /compute/v2.1/os-volumes/f1816a53-701e-4030-b511-771672c65613 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:48:42.222311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b788c160-8d7c-4633-b3c0-717ff755e4dd tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf230ed30>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:42.310811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b788c160-8d7c-4633-b3c0-717ff755e4dd tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/59cbd098-54fe-4d92-8c85-e964665d0f3e" status: 200 len: 350 microversion: 2.1 time: 0.098615 Jan 27 16:48:42.311353 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 10/11] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:42 2022] GET /compute/v2.1/os-volumes/59cbd098-54fe-4d92-8c85-e964665d0f3e => generated 350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:48:42.875015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-811ba034-c517-4b93-a365-87769363aadd tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf230eee0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:42.987803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-811ba034-c517-4b93-a365-87769363aadd tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 200 len: 354 microversion: 2.1 time: 0.118235 Jan 27 16:48:42.988940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 11/12] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:42 2022] GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:43.172649 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1182948069", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "e61a4ef3-534d-479d-8867-5085e7d92be1"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:43.387629 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] validate_networks() for [('e61a4ef3-534d-479d-8867-5085e7d92be1', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:48:43.753766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:48:43.753766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:48:43.753766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:48:43.753766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:48:43.753766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:48:43.760499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:43.760499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:43.760499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:43.760499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:43.786539 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Getting quotas for project 8930d227a39349b8a900ed8395fb7d2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:48:43.795494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Getting quotas for user fe12b69fda1e4bb0953ec32f2f8d4864 and project 8930d227a39349b8a900ed8395fb7d2b. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:48:43.813465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:48:43.817683 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:48:43.964949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4ddacf93-e240-4238-96e7-d3765860f181 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.042481 Jan 27 16:48:43.978277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 2/13] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:48:43.988828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e2d36907-fe06-4157-bbf0-5dd38f4890ef tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf22435e0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:44.115306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e2d36907-fe06-4157-bbf0-5dd38f4890ef tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 200 len: 354 microversion: 2.1 time: 0.132964 Jan 27 16:48:44.116318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 3/14] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:43 2022] GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 354 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:44.130700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-46f4e093-61d3-4653-8383-7d460c5bdf1f tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf19de310>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:44.248528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-46f4e093-61d3-4653-8383-7d460c5bdf1f tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/475e331b-bf22-4365-b9fa-59308c33497a" status: 200 len: 351 microversion: 2.1 time: 0.128823 Jan 27 16:48:44.254734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:44 2022] GET /compute/v2.1/os-volumes/475e331b-bf22-4365-b9fa-59308c33497a => generated 351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:44.255909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-999f0b0d-2002-47a1-a49a-0c7aeb07e0c6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:44.257212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-999f0b0d-2002-47a1-a49a-0c7aeb07e0c6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:44.581663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-999f0b0d-2002-47a1-a49a-0c7aeb07e0c6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:44.609420 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-999f0b0d-2002-47a1-a49a-0c7aeb07e0c6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1214 microversion: 2.1 time: 0.358183 Jan 27 16:48:44.610294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 5/16] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:44 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1214 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:44.641677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0600b67b-f438-4a81-ab93-6528d1830f07 tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf11c09d0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:44.866171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0600b67b-f438-4a81-ab93-6528d1830f07 tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 202 len: 0 microversion: 2.1 time: 0.255555 Jan 27 16:48:44.868441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 6/17] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:48:44 2022] DELETE /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:48:44.877990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9873ab6a-a585-4951-91e2-c04f57b20cf7 tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf11c0dc0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:44.954537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9873ab6a-a585-4951-91e2-c04f57b20cf7 tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 200 len: 353 microversion: 2.1 time: 0.082028 Jan 27 16:48:44.955889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 7/18] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:44 2022] GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:45.537788 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:48:45.538403 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:48:45.538965 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:48:45.539592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:48:45.540120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:48:45.583916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:45.587943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:45.592002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:45.595785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:45.627041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ab38358b-68f1-4d85-a6c6-f5fc46a1faf5 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:45.631381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ab38358b-68f1-4d85-a6c6-f5fc46a1faf5 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:45.718738 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:48:45.739700 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for user 3cfe4a71879849b581eb8b48b24107fd and project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:48:45.771251 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:48:45.786637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:48:45.857645 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ab38358b-68f1-4d85-a6c6-f5fc46a1faf5 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:45.870760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ab38358b-68f1-4d85-a6c6-f5fc46a1faf5 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1214 microversion: 2.1 time: 0.247031 Jan 27 16:48:45.885689 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 8/19] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:45 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1214 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:45.968034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1ad09e48-6187-4451-90ae-a9ad4056a35b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Calling method '.version_select at 0x7f0cf11618b0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.037739 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-1ad09e48-6187-4451-90ae-a9ad4056a35b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] HTTP exception thrown: Volume dbbd4b20-e8a9-435f-a585-33ff35b469e8 could not be found. Jan 27 16:48:46.038744 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1ad09e48-6187-4451-90ae-a9ad4056a35b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] Returning 404 to user: Volume dbbd4b20-e8a9-435f-a585-33ff35b469e8 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:48:46.040376 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1ad09e48-6187-4451-90ae-a9ad4056a35b tempest-VolumesGetTestJSON-292324014 tempest-VolumesGetTestJSON-292324014-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8" status: 404 len: 109 microversion: 2.1 time: 0.076550 Jan 27 16:48:46.041452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 9/20] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:45 2022] GET /compute/v2.1/os-volumes/dbbd4b20-e8a9-435f-a585-33ff35b469e8 => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:48:46.059634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e759c87f-88ab-496a-a7dd-741290468893 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.064419 Jan 27 16:48:46.060391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 12/21] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:48:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:48:46.072855 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ff7f186c-0aa4-4885-b678-e0cc62b75340 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf232e430>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.080083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5c896e1d-e571-4a92-86fe-2942ff635ad3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.089798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5c896e1d-e571-4a92-86fe-2942ff635ad3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:46.208910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ff7f186c-0aa4-4885-b678-e0cc62b75340 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5525a396-a9b2-47af-b8f3-7749cf8cb9b3" status: 200 len: 350 microversion: 2.1 time: 0.166068 Jan 27 16:48:46.210298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/os-volumes/5525a396-a9b2-47af-b8f3-7749cf8cb9b3 => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:46.222474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bb785aad-8166-4498-baef-de3caae3cf82 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf1161040>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.413742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bb785aad-8166-4498-baef-de3caae3cf82 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.195775 Jan 27 16:48:46.423157 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1133 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:46.429609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e6fa6752-f9d7-4048-a893-42bde18632f3 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf1159820>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.546998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5c896e1d-e571-4a92-86fe-2942ff635ad3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:46.563834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e6fa6752-f9d7-4048-a893-42bde18632f3 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.138512 Jan 27 16:48:46.564709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 12/24] 10.222.0.48 () {58 vars in 1148 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:46.578104 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5c896e1d-e571-4a92-86fe-2942ff635ad3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1218 microversion: 2.1 time: 0.506325 Jan 27 16:48:46.578971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ba7154c8-1c5f-45a1-836c-a77993b55e11 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf11658b0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.579348 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 13/25] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1218 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:46.861596 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ba7154c8-1c5f-45a1-836c-a77993b55e11 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.287317 Jan 27 16:48:46.862692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1133 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:46.880506 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-445fb44a-3a69-43be-a79c-f7f661ae7369 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf19b25e0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.893754 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:46.894492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:46.913908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:46.914374 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:46.915295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:46.934197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:47.037949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-445fb44a-3a69-43be-a79c-f7f661ae7369 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.167101 Jan 27 16:48:47.038524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 14/27] 10.222.0.48 () {58 vars in 1166 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:47.051491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e3f2d4cb-4171-48d1-848e-930ee1507fea tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf11680d0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:47.241749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e3f2d4cb-4171-48d1-848e-930ee1507fea tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194039 Jan 27 16:48:47.242321 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1169 bytes} [Thu Jan 27 16:48:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:48:47.254769 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-93e208ae-7568-4857-9a04-04b43f96ea61 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf115dd30>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:47.342549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:47.398700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f33e20f7-4beb-4433-a529-4226ce05481a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1266 microversion: 2.1 time: 0.505612 Jan 27 16:48:47.413472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 14/29] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:46 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1266 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:47.509386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-93e208ae-7568-4857-9a04-04b43f96ea61 tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.258063 Jan 27 16:48:47.509957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 16/30] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jan 27 16:48:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:47.521929 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a194d47d-560d-4489-93b4-a97be06d56fc tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf116df70>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:47.596663 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a86c0298-512c-48a9-b0c4-7707e71dc4ac tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:47.598061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a86c0298-512c-48a9-b0c4-7707e71dc4ac tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:47.692725 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a194d47d-560d-4489-93b4-a97be06d56fc tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.174485 Jan 27 16:48:47.702008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 15/31] 10.222.0.48 () {58 vars in 1187 bytes} [Thu Jan 27 16:48:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:48:47.707172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a25f6b96-4247-42f9-a28e-4686ac36162d tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] Calling method '.version_select at 0x7f0cf10deaf0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:47.897642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a25f6b96-4247-42f9-a28e-4686ac36162d tempest-VolumesTestJSON-2069539320 tempest-VolumesTestJSON-2069539320-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.194194 Jan 27 16:48:47.918796 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 16/32] 10.222.0.48 () {58 vars in 1154 bytes} [Thu Jan 27 16:48:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:48.141388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a86c0298-512c-48a9-b0c4-7707e71dc4ac tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:48.154472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a86c0298-512c-48a9-b0c4-7707e71dc4ac tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1218 microversion: 2.1 time: 0.557834 Jan 27 16:48:48.155090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 17/33] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:47 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1218 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:48.424859 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:48.425516 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:48.441002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:48.441461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:48.444758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:48.445208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:48.613766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:48.622435 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-90bb9665-bf1a-42e1-a67c-a664d6e7d49d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.205691 Jan 27 16:48:48.625094 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 17/34] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:48 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:49.180189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:49.180961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:49.200595 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:49.201065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:49.201892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:49.202387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:49.642617 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:49.643320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:49.660151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:49.660605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:49.688150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:49.688150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:49.998677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:50.005086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:50.015903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1824bc8d-53a3-43fa-98b4-aa8c215c5de8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.377501 Jan 27 16:48:50.016494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:49 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:50.032957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25f63067-ada4-4d55-8145-218b82f5e397 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1288 microversion: 2.1 time: 0.856231 Jan 27 16:48:50.033946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 18/36] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:49 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1288 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:51.035377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:51.036534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:51.051320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:51.052536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:51.060551 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:51.064847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:51.065383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:51.066185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:51.066303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:51.068448 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:51.069238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:51.069645 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:51.249952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:51.254666 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8c42d05a-37c5-4b89-a481-910bfbc82f72 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1276 microversion: 2.1 time: 0.207001 Jan 27 16:48:51.255267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:51 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1276 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:51.526143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:51.561197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a06c6aad-b7ad-4e02-8e47-9269642897b6 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.531334 Jan 27 16:48:51.561826 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 19/38] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:51 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:52.274215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:52.274835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:52.284703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:52.293931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:52.299088 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:52.303990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:52.510716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:52.559821 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-76c6805b-3ee7-412a-8b45-5e78c136c821 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1276 microversion: 2.1 time: 0.287862 Jan 27 16:48:52.567192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 20/39] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:52 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:52.585432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:52.586676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:52.600476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:52.608603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:52.612810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:52.628198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:53.003501 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:53.040199 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1c242c95-552e-4f34-b6d6-c1cee2e6b3fd tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.456878 Jan 27 16:48:53.041440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 20/40] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:52 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:53.583415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:53.585959 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:53.602080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:53.607224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:53.609075 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:53.611893 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:53.946865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:53.955485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-553204ab-e3b7-4e60-9561-2d33b666d488 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1276 microversion: 2.1 time: 0.376913 Jan 27 16:48:53.964205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:53 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1276 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:54.059782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:54.060686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:54.082683 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:54.083059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:54.086646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:54.087134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:54.573805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:54.584962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8cccff73-90ae-4931-98d6-ece770bd220c tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.530388 Jan 27 16:48:54.599471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 21/42] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:54 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:54.956933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: .version_select at 0x7f0cf10ec040>, body: {"keypair": {"name": "tempest-keypair-1384134626"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:48:54.979765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:54.981421 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:54.998416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:55.002097 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:55.004603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:55.007607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:55.031410 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:48:55.045890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:48:55.501613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:55.512600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5a05ab1d-3d17-4be0-813a-ef0cb983507f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1276 microversion: 2.1 time: 0.535955 Jan 27 16:48:55.514000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 22/43] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:54 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1276 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:55.608097 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:55.608969 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:55.629329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:55.630869 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:55.637133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:55.637637 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:55.947148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:55.968593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6b91b075-a50c-427c-944e-fa3e5f63e074 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.366676 Jan 27 16:48:55.971292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:55 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:48:56.232980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:48:56.253986 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:48:56.311614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d3f80e6f-e8ce-4c7a-979c-b49f82cc3129 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.760925 Jan 27 16:48:56.321449 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1157 bytes} [Thu Jan 27 16:48:54 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:56.530914 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:56.532782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:56.550957 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:56.551354 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:56.552197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:56.552642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:56.808081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:56.824753 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2dd3a6e8-ca60-4fe1-a84b-c7302a0b6f70 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1276 microversion: 2.1 time: 0.297661 Jan 27 16:48:56.830767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 24/46] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:56 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:56.988172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:56.988997 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:57.003335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:57.006283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:57.007398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:57.008238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:57.389646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:57.402562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2055a221-7761-4423-8b4a-a2e735ba70bf tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1272 microversion: 2.1 time: 0.416080 Jan 27 16:48:57.403212 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 23/47] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:56 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:57.846517 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:57.847844 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:57.856979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:57.857696 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:57.861415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:57.862137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:58.419368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:48:58.420015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:48:58.432512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:58.433800 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:58.434766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:48:58.435375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:48:59.315004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:59.357590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0154620f-ab18-4dc3-a17c-4f3dc8a0ac06 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 1.514344 Jan 27 16:48:59.359819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:57 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:48:59.752644 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:48:59.768758 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-128f7089-a3cb-442b-b203-196068770def tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 1.352996 Jan 27 16:48:59.778208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 24/49] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:48:58 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:00.375554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:00.377242 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:00.393013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:00.396365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:00.399121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:00.405314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:01.219628 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-854430956", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:01.361751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] validate_networks() for [('d601b71c-9e85-4907-a350-1cc1a1486f21', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:49:02.155217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:02.178037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-734436b8-e66f-46e1-be3b-eea48c87a98b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 1.799693 Jan 27 16:49:02.180430 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 25/50] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:00 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:02.186436 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:02.187055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:02.219585 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:02.220286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:02.221252 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:02.221849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:03.614559 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:03.630261 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b52c7703-b0f3-4282-be7b-7a88b3e531f0 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 1.447110 Jan 27 16:49:03.631536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 26/51] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:02 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:03.648192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:03.649434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:03.668346 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:03.670371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:03.688350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:03.689066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:04.272426 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:04.281536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b860db64-3714-487c-b094-86fa7d1a5cf7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.647030 Jan 27 16:49:04.291398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 27/52] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:03 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:04.301651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1385316449", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e5124e-533e-45d6-b9d3-79afca1c35e2"}], "security_groups": [{"name": "tempest-securitygroup--1996501120"}], "key_name": "tempest-keypair-1384134626", "user_data": "}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:04.869243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:49:04.869722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:49:04.870130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:49:04.875604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:49:04.876049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:49:04.888846 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:04.889297 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:04.890342 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:04.890780 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:04.918746 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Getting quotas for project 326cd822c847423ba2417f593ca8c6ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:04.923032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Getting quotas for user c2c8a269081c42abae453a5be4772d50 and project 326cd822c847423ba2417f593ca8c6ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:04.940128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:49:04.948129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:49:05.027697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9431ca8a-2e98-4175-84c2-ac6ddbb64c1c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.760565 Jan 27 16:49:05.028851 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 26/53] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:49:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:49:05.045411 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] validate_networks() for [('d4e5124e-533e-45d6-b9d3-79afca1c35e2', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:49:05.113529 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d965b6d0-4b97-4175-babd-be6034796512 req-a2c6b015-1753-4f1e-a9b0-4816084bcc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9d62e6-6196-4c6f-ba02-dcf3fece8937", "tag": "2d2494c4-b7fe-4dc9-8d66-cb83f755ac04"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:05.115930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:05.115930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:05.130364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d965b6d0-4b97-4175-babd-be6034796512 req-a2c6b015-1753-4f1e-a9b0-4816084bcc9a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:05.130998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d965b6d0-4b97-4175-babd-be6034796512 req-a2c6b015-1753-4f1e-a9b0-4816084bcc9a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:05.163997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d965b6d0-4b97-4175-babd-be6034796512 req-a2c6b015-1753-4f1e-a9b0-4816084bcc9a service nova] Creating event network-changed:2d2494c4-b7fe-4dc9-8d66-cb83f755ac04 for instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 on hv-cinder-81883 Jan 27 16:49:05.164836 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d965b6d0-4b97-4175-babd-be6034796512 req-a2c6b015-1753-4f1e-a9b0-4816084bcc9a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 27 16:49:05.166348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:05.167004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:05.168533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:05.169666 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:05.181455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.compute.rpcapi [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 27 16:49:05.182659 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] Releasing lock "compute-rpcapi-router" {{(pid=127795) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 27 16:49:05.221066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-78043e9b-3406-4b2f-b324-da9324ae1973 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190706 Jan 27 16:49:05.222509 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 27/54] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:05.228218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:05.229819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:05.252043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:05.252509 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:05.253816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:05.254444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:05.980212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:05.991355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f17bf008-15e6-4242-bbae-5a26bf25987a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.765991 Jan 27 16:49:05.992232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 28/55] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:05 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:06.006385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-77cad268-8987-49dd-9a7a-727f0e907a14 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:06.011245 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-77cad268-8987-49dd-9a7a-727f0e907a14 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:06.159424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-77cad268-8987-49dd-9a7a-727f0e907a14 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:06.175146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-77cad268-8987-49dd-9a7a-727f0e907a14 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1221 microversion: 2.1 time: 0.179857 Jan 27 16:49:06.178521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 29/56] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:05 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:06.188437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:06.190606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:06.217806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:06.218659 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:06.219819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:06.220952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:06.298599 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:49:06.299058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:49:06.299489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:49:06.300109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:49:06.300729 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:49:06.319465 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:06.323111 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:06.327223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:06.330003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:06.380234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:06.386646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:06.412944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:49:06.416429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:49:06.529650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ea5b9493-fb32-431c-b925-d194142ec2cb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.236973 Jan 27 16:49:06.537137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:06.555123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:49:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 2263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:49:06.557571 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f49da008-ba53-4452-a30d-517e6147f9ed tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.377780 Jan 27 16:49:06.562610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 30/58] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:06 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:06.582584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1799141610", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:06.666227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] validate_networks() for [('d601b71c-9e85-4907-a350-1cc1a1486f21', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:49:06.924580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: .version_select at 0x7f0cf10d4d30>, body: {"keypair": {"name": "tempest-keypair-837299887"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:06.943843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:06.949284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:07.335876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:07.346934 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:07.407253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7a7c594d-fcc4-4f29-8cda-64134ac87f36 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.848493 Jan 27 16:49:07.412217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 29/59] 10.222.0.48 () {62 vars in 1198 bytes} [Thu Jan 27 16:49:06 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 856 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:49:07.420440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:07.421983 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:07.443360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.443958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.445031 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.447294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.668862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:07.685394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-39f48cfa-7ec0-4f18-9776-93e0a243a9c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1242 microversion: 2.1 time: 0.269445 Jan 27 16:49:07.687276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 30/60] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:07 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1242 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:07.706797 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:07.709198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:07.723561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.724221 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.725171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.728487 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.873436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:49:07.874675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:49:07.875304 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:49:07.875828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:49:07.876254 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:49:07.886311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.887034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.890869 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:07.891758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:07.955115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Getting quotas for project 326cd822c847423ba2417f593ca8c6ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:07.962796 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Getting quotas for user c2c8a269081c42abae453a5be4772d50 and project 326cd822c847423ba2417f593ca8c6ff. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:07.982374 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:49:07.991102 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:49:08.086069 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fea11c4b-49a8-46c6-affc-4b523686d878 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.520811 Jan 27 16:49:08.093083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:49:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:49:08.098662 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-dc994609-0b98-433d-85fc-f8805dd51c1d req-67b276ae-f04e-4a3b-989e-d49b37773c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0a7f18-d314-4368-bed8-cb27c0ba466b", "tag": "edeff32f-9844-440c-a9f3-215374de7bd3"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:08.100503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:08.100503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:08.109202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-dc994609-0b98-433d-85fc-f8805dd51c1d req-67b276ae-f04e-4a3b-989e-d49b37773c96 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:08.109911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-dc994609-0b98-433d-85fc-f8805dd51c1d req-67b276ae-f04e-4a3b-989e-d49b37773c96 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:08.124703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-dc994609-0b98-433d-85fc-f8805dd51c1d req-67b276ae-f04e-4a3b-989e-d49b37773c96 service nova] Creating event network-changed:edeff32f-9844-440c-a9f3-215374de7bd3 for instance 2a0a7f18-d314-4368-bed8-cb27c0ba466b on hv-cinder-81883 Jan 27 16:49:08.131384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-dc994609-0b98-433d-85fc-f8805dd51c1d req-67b276ae-f04e-4a3b-989e-d49b37773c96 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036619 Jan 27 16:49:08.132286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 32/62] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:08.144421 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:08.145487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:08.154314 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:08.154894 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:08.156772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:08.157692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:08.290483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:08.299932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a103bbd0-8020-42b2-ac28-39820dd44d8e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.611404 Jan 27 16:49:08.304196 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:07 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:08.310060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-96a5dcd5-a23b-40c2-ab3f-cd26720ee8b5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:08.321234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-96a5dcd5-a23b-40c2-ab3f-cd26720ee8b5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:08.426504 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-96a5dcd5-a23b-40c2-ab3f-cd26720ee8b5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:08.436385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-96a5dcd5-a23b-40c2-ab3f-cd26720ee8b5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1222 microversion: 2.1 time: 0.130606 Jan 27 16:49:08.436971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 32/64] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:08 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:08.538317 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:08.553496 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4de6502a-6f5c-41f7-95e1-1b0cb998f14e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.414274 Jan 27 16:49:08.563919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:08 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:08.703906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:08.704547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:08.712367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:08.712848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:08.713737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:08.714364 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:08.867753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:08.885097 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f3a33ed5-a5d1-44d8-be86-6c4e2d7938ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1290 microversion: 2.1 time: 0.180058 Jan 27 16:49:08.896145 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 33/66] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:08 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1290 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:09.320451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:09.321743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:09.329832 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.330404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.331515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.332271 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.453246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:09.453906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:09.465038 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.465740 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.467339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.472268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.769971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:09.785370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6319c1e2-2732-4bcc-99f4-412835790869 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1226 microversion: 2.1 time: 0.336020 Jan 27 16:49:09.789483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:09 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1226 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:09.799624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:09.800253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:09.809039 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.809499 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.810311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.810946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.830604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:09.840614 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f0c876d2-9d82-41ff-b282-3570e14481fc tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.523611 Jan 27 16:49:09.849822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 34/68] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:09 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:09.905644 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:09.906410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:09.914391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.915086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:09.916147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:09.916734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:10.006134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:10.012673 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-aa1ab973-4c80-4dd9-b1d3-f59bd02da6a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1290 microversion: 2.1 time: 0.112372 Jan 27 16:49:10.015582 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 35/69] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:09 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:10.122264 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:10.132452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-26323a00-e896-44b3-8e5c-f81daa06e0be tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.341242 Jan 27 16:49:10.137792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 35/70] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:09 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:10.591331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-171066313", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e17d67f-4d84-42b2-a3bf-cf48fd71687d"}], "security_groups": [{"name": "tempest-securitygroup--984872794"}], "key_name": "tempest-keypair-837299887", "user_data": "}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:10.804471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:10.805265 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:10.821286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:10.825075 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:10.828820 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:10.831720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:11.122762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:11.130413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-dfbc0404-8c37-4d50-9049-8b2919ee96ea tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1274 microversion: 2.1 time: 0.330560 Jan 27 16:49:11.134528 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:10 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1274 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:11.148126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:11.148752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:11.184270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:11.184849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:11.190118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:11.190641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:11.363047 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] validate_networks() for [('4e17d67f-4d84-42b2-a3bf-cf48fd71687d', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:49:12.107237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:12.122809 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9521886c-35e7-4e64-b8b8-8c6ed9571773 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.987194 Jan 27 16:49:12.125254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 37/72] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:11 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:12.131123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:12.134057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:12.161697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:12.166153 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:12.167364 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:12.168957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:12.280748 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:12.291076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-85467f81-a797-4ab4-879f-3c8b752eeeb6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1296 microversion: 2.1 time: 0.163461 Jan 27 16:49:12.291961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 38/73] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:12 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1296 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:12.296963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:12.302055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:12.318948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:12.327013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:12.328287 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:12.329407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:12.991118 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:49:12.991713 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:49:12.992014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:49:12.992872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:49:12.992872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:49:13.009854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.010291 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.011847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.012540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.049947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:13.054552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:13.076478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:49:13.079169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:49:13.098373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.106334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5b509ae6-ef33-4b0f-aecf-9b87891f9527 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.812882 Jan 27 16:49:13.106913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 39/74] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:12 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:13.113692 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:13.114307 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:13.120286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.120990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.121793 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.122211 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.159667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-19e95a77-ce95-4b17-96a6-125cbbc99ad9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.573181 Jan 27 16:49:13.160594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 36/75] 10.222.0.48 () {62 vars in 1187 bytes} [Thu Jan 27 16:49:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 2575 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 27 16:49:13.165729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:13.166519 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:13.174267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.174935 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.175899 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.176473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.218961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.237166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a00230b4-4475-407a-88bb-d81130073437 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1280 microversion: 2.1 time: 0.129212 Jan 27 16:49:13.250774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 40/76] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:13 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1280 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:13.259339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:13.260316 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:13.396246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.406296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.413567 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.414688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e0450475-2e30-42d5-b030-dbb688200a6c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1280 microversion: 2.20 time: 0.162569 Jan 27 16:49:13.415338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 41/77] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:13 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:13.426769 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:13.430119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:13.446212 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.446669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.447476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.451954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.452272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.460805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6c7699ae-3654-4217-b923-09b7c26a578a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.298679 Jan 27 16:49:13.472100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 37/78] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:13 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:13.561061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:13.571884 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f5d55357-8ca4-4c96-bc2d-339cfb9f307a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1296 microversion: 2.1 time: 0.151296 Jan 27 16:49:13.574276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 42/79] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:13 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1296 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:13.628635 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-4566d8c0-0862-441f-a730-6b5dba5e1354 req-535b2f15-1b60-4ec5-afcb-ce8a5f71544f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2", "tag": "0f3362f6-2e54-4b45-89fc-94c7ecae5a49"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:13.632191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:13.632191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:13.648560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-4566d8c0-0862-441f-a730-6b5dba5e1354 req-535b2f15-1b60-4ec5-afcb-ce8a5f71544f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:13.649798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-4566d8c0-0862-441f-a730-6b5dba5e1354 req-535b2f15-1b60-4ec5-afcb-ce8a5f71544f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:13.671207 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-4566d8c0-0862-441f-a730-6b5dba5e1354 req-535b2f15-1b60-4ec5-afcb-ce8a5f71544f service nova] Creating event network-changed:0f3362f6-2e54-4b45-89fc-94c7ecae5a49 for instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 on hv-cinder-81883 Jan 27 16:49:13.676932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-4566d8c0-0862-441f-a730-6b5dba5e1354 req-535b2f15-1b60-4ec5-afcb-ce8a5f71544f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053461 Jan 27 16:49:13.677849 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 38/80] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:14.126593 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:14.127435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:14.136374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.137366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.138402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.156166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.258920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:14.259824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:14.275237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.276315 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.279856 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.280473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.427918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:14.441498 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-09d457c8-3b6b-4a37-8cfa-cf1208a29d87 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.318378 Jan 27 16:49:14.442442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:14 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:14.455311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:14.456284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:14.464482 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.464952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.465920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.466390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.671319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:14.681518 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:14.686080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:14.689292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-408a1bcd-2275-4918-8754-a2efa03f1d69 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1332 microversion: 2.20 time: 0.244113 Jan 27 16:49:14.692131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 44/82] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:14 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1332 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:14.708994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:14.713787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:14.727287 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.728747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.730751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.733388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.904622 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:14.917517 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ddf10bfd-a325-4dfb-8e5f-050f4b04f13b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.658884 Jan 27 16:49:14.921130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 39/83] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:14 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:14.938353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:14.939949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:14.962127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.966327 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:14.968345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:14.968782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.279132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.301856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-42aa2d88-ad7e-4591-944e-1e6a17e9dd4b tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.606219 Jan 27 16:49:15.302439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 45/84] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:14 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:15.419115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-8df665f0-60ae-40e8-aed8-3c430ec98820 req-010db91b-8b22-44c8-9ece-b91a9ab3b7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0a7f18-d314-4368-bed8-cb27c0ba466b", "name": "network-vif-plugged", "status": "completed", "tag": "edeff32f-9844-440c-a9f3-215374de7bd3"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:15.422003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:15.422003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:15.444017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8df665f0-60ae-40e8-aed8-3c430ec98820 req-010db91b-8b22-44c8-9ece-b91a9ab3b7c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.444792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8df665f0-60ae-40e8-aed8-3c430ec98820 req-010db91b-8b22-44c8-9ece-b91a9ab3b7c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.466683 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.469759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-8df665f0-60ae-40e8-aed8-3c430ec98820 req-010db91b-8b22-44c8-9ece-b91a9ab3b7c8 service nova] Creating event network-vif-plugged:edeff32f-9844-440c-a9f3-215374de7bd3 for instance 2a0a7f18-d314-4368-bed8-cb27c0ba466b on hv-cinder-81883 Jan 27 16:49:15.470755 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8df665f0-60ae-40e8-aed8-3c430ec98820 req-010db91b-8b22-44c8-9ece-b91a9ab3b7c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127796) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 27 16:49:15.473405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.474144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.475110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.475683 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0b213b6b-241e-4559-be8a-a717ede3163d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.552357 Jan 27 16:49:15.475876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.476266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 40/85] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:14 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:15.481177 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:15.481778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:15.491182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.compute.rpcapi [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 27 16:49:15.492362 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] Releasing lock "compute-rpcapi-router" {{(pid=127796) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 27 16:49:15.503068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.504323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.506109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.506848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.530372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fda70d5c-0526-41ed-a013-abf8eeb5422f None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226002 Jan 27 16:49:15.531230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 46/86] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:15.712272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:15.713058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:15.725797 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.726325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.731474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.732270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.825232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.833363 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ef77dc53-1227-4388-92c0-44d1e699a81a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.356092 Jan 27 16:49:15.834889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 41/87] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:15 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:15.873027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.880929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.882660 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:15.883802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-82698b9b-05f3-434e-aa8d-a43f1b2d5315 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1338 microversion: 2.20 time: 0.177453 Jan 27 16:49:15.895044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 47/88] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:15 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1338 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:49:15.936565 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:15.936953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:15.944391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.945143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:15.946126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:15.946758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:16.293501 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:16.306211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d817f783-068e-4394-8009-d4041ce506e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.373775 Jan 27 16:49:16.307963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:15 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:16.325061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:16.325679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:16.334003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:16.334767 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:16.335917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:16.336549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:16.493763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:16.494433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:16.504068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:16.504951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:16.506162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:16.506784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:16.981735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:16.989103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5da556af-7e7c-4a5e-a2a4-7bb5502c712e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.670747 Jan 27 16:49:16.989681 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 48/90] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:16 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:16.994260 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-0cc56322-b475-413c-a693-16f5b82e8718 req-515c4c33-e967-403a-b2aa-0d8a0b7ff9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dbabab-3baf-4446-aaad-bdd80b162cd7", "tag": "c7ee8f95-4b6c-4378-a74a-658d33610c09"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:16.995890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:16.995890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:17.003513 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-0cc56322-b475-413c-a693-16f5b82e8718 req-515c4c33-e967-403a-b2aa-0d8a0b7ff9bf service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.003990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-0cc56322-b475-413c-a693-16f5b82e8718 req-515c4c33-e967-403a-b2aa-0d8a0b7ff9bf service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.015022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-0cc56322-b475-413c-a693-16f5b82e8718 req-515c4c33-e967-403a-b2aa-0d8a0b7ff9bf service nova] Creating event network-changed:c7ee8f95-4b6c-4378-a74a-658d33610c09 for instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 on hv-cinder-81883 Jan 27 16:49:17.019917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-0cc56322-b475-413c-a693-16f5b82e8718 req-515c4c33-e967-403a-b2aa-0d8a0b7ff9bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029097 Jan 27 16:49:17.020509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 49/91] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:17.025473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:17.026804 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:17.035059 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.035540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.036313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.036762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.037977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.045854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4ab72a9e-fe37-400f-95f2-6c682c7754d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.555525 Jan 27 16:49:17.046438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 43/92] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:16 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:17.055609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:17.055609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:17.062279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.062933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.063886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.064896 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.247407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.254857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.255155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-68ea4d61-9a5f-4a13-b094-98207fe51a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.233525 Jan 27 16:49:17.256114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 50/93] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:17 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:17.264309 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.265985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.267153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a1c6f402-2bfe-464d-af76-57ee237d60d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.219806 Jan 27 16:49:17.267897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 44/94] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:17 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:17.327122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:17.327122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:17.330018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.330481 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.331216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.331670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.480993 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:17.493053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4ebd8428-7ba3-4b52-acb2-f6b607917566 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.173273 Jan 27 16:49:17.493641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 51/95] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:17 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:17.569913 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-725a2e36-119e-484e-a505-7151b2d34562 req-53caf224-fba3-42e5-ad84-59f41aa8b725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d62e6-6196-4c6f-ba02-dcf3fece8937", "name": "network-vif-plugged", "status": "completed", "tag": "2d2494c4-b7fe-4dc9-8d66-cb83f755ac04"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:17.571729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:17.571729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:17.579337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-725a2e36-119e-484e-a505-7151b2d34562 req-53caf224-fba3-42e5-ad84-59f41aa8b725 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:17.579820 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-725a2e36-119e-484e-a505-7151b2d34562 req-53caf224-fba3-42e5-ad84-59f41aa8b725 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:17.591601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-725a2e36-119e-484e-a505-7151b2d34562 req-53caf224-fba3-42e5-ad84-59f41aa8b725 service nova] Creating event network-vif-plugged:2d2494c4-b7fe-4dc9-8d66-cb83f755ac04 for instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 on hv-cinder-81883 Jan 27 16:49:17.596866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-725a2e36-119e-484e-a505-7151b2d34562 req-53caf224-fba3-42e5-ad84-59f41aa8b725 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030604 Jan 27 16:49:17.597477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 45/96] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:18.005833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:18.006448 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:18.013102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.013548 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.014317 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.014748 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.063398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:18.064123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:18.070715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.071218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.072130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.072653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.191921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.201139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ca901503-859b-48f3-982f-6f28cbf67ecb tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.198833 Jan 27 16:49:18.201691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 52/97] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:18 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:18.240892 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.248536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-eeb7b5c7-3d63-4496-8947-53124d764cd9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.189143 Jan 27 16:49:18.249096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 46/98] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:18 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:18.272113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:18.272721 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:18.279072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.281102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.281102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.281102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.286680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:18.287527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:18.293443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.293898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.294692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.295128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.779154 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.789442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.798148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.799604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-180f8c5b-4578-4fb6-b92a-4ced43ba1f34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.517085 Jan 27 16:49:18.800329 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:18.800875 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 47/99] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:18 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:49:18.810623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:18.817268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:18.817451 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4dcac66d-e4df-4db3-aa5c-01ba2006b054 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.548714 Jan 27 16:49:18.818197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:18 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:18.825482 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.825931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:18.826723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:18.827153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.050957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-09ba85a0-bb08-4fe1-ad4a-81a19e29ddfa req-68392ebd-9581-4e6b-9fd8-b088a49c4ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5490cbd-3604-4065-b528-a305f9f211ce", "tag": "8e60561d-e86c-4bcf-b188-6be71158ac4e"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:19.052566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:19.052566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:19.063300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-09ba85a0-bb08-4fe1-ad4a-81a19e29ddfa req-68392ebd-9581-4e6b-9fd8-b088a49c4ace service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.064122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-09ba85a0-bb08-4fe1-ad4a-81a19e29ddfa req-68392ebd-9581-4e6b-9fd8-b088a49c4ace service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.081268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-09ba85a0-bb08-4fe1-ad4a-81a19e29ddfa req-68392ebd-9581-4e6b-9fd8-b088a49c4ace service nova] Creating event network-changed:8e60561d-e86c-4bcf-b188-6be71158ac4e for instance b5490cbd-3604-4065-b528-a305f9f211ce on hv-cinder-81883 Jan 27 16:49:19.088394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-09ba85a0-bb08-4fe1-ad4a-81a19e29ddfa req-68392ebd-9581-4e6b-9fd8-b088a49c4ace service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040981 Jan 27 16:49:19.089933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 54/101] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:19.218420 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:19.219503 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:19.227400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.228075 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.229932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.230445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.306723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:19.314718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a75a9407-c33d-4135-ad32-8e8e04c295eb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.512632 Jan 27 16:49:19.315302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 48/102] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:18 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:19.332175 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:19.332776 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:19.346279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.346890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.356368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.357061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.747754 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:19.758175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0d182354-be06-44e6-b8b8-c9c95218fa98 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.543725 Jan 27 16:49:19.768619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 55/103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:19 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:19.818125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:19.818719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:19.827082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.829305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.830335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.833254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.866646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:19.875122 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-83c9ebd3-f591-4f62-ae1c-a414c6252832 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.546524 Jan 27 16:49:19.881500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 49/104] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:19 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:19.896524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:19.903793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:19.921973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.922815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:19.926929 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:19.927509 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.196918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.209264 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.211877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.213230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-768726b1-ff3f-4a98-9bd8-ef2aacb86292 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.398921 Jan 27 16:49:20.215508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 56/105] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:19 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:49:20.318235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.332714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:20.333732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:20.340369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ab504e33-bb50-4eb2-8b57-6879c9cf2ca3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.457391 Jan 27 16:49:20.350445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.351343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 50/106] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:19 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:20.351990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.353705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.354666 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.586824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-129f6aed-19d4-4db3-8526-94cccb16f77e req-036d3877-c865-4fd1-be73-45693bb2c7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:20.589051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:20.589051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:20.596972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-129f6aed-19d4-4db3-8526-94cccb16f77e req-036d3877-c865-4fd1-be73-45693bb2c7e0 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.597537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-129f6aed-19d4-4db3-8526-94cccb16f77e req-036d3877-c865-4fd1-be73-45693bb2c7e0 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.622340 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-129f6aed-19d4-4db3-8526-94cccb16f77e req-036d3877-c865-4fd1-be73-45693bb2c7e0 service nova] Creating event network-changed:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:49:20.637153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-129f6aed-19d4-4db3-8526-94cccb16f77e req-036d3877-c865-4fd1-be73-45693bb2c7e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128189 Jan 27 16:49:20.643147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 51/107] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:20.759621 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.768928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-837272b4-901d-4dbd-9ecb-37af01622a86 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.440352 Jan 27 16:49:20.771062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 57/108] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:20 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:20.779460 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:20.780179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:20.786438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.787034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.788098 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.788693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.898090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:20.900184 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:20.907910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.908713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.909668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:20.910825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:20.950973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:20.958231 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-94cb37dd-d2cd-40ba-a79c-2a1d912dc26a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.185745 Jan 27 16:49:20.958795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 52/109] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:20 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:21.089183 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.096623 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-85f15a66-a48d-4307-ace6-cbe6016fbc2b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.203367 Jan 27 16:49:21.097200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 58/110] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:20 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:21.232957 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:21.233584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:21.239204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.239674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.240446 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.240876 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.384219 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:21.386010 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:21.396731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.397777 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.398759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.399585 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.427058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.435282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.437869 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.439221 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-26fc6fad-2454-4649-9ede-79d9133ce6eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.210743 Jan 27 16:49:21.440382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 53/111] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:21 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:21.560863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.568534 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e684d8ad-64f6-43dd-a7b0-7b14ae42c002 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.192613 Jan 27 16:49:21.569424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 59/112] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:21 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:21.727434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d0414897-8a85-453c-a8ad-3470ad51ccc9 req-b57e1cf2-2203-476f-88db-f8ff42552f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2", "name": "network-vif-plugged", "status": "completed", "tag": "0f3362f6-2e54-4b45-89fc-94c7ecae5a49"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:21.727434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:21.727434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:21.734243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0414897-8a85-453c-a8ad-3470ad51ccc9 req-b57e1cf2-2203-476f-88db-f8ff42552f88 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.734697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0414897-8a85-453c-a8ad-3470ad51ccc9 req-b57e1cf2-2203-476f-88db-f8ff42552f88 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.747471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d0414897-8a85-453c-a8ad-3470ad51ccc9 req-b57e1cf2-2203-476f-88db-f8ff42552f88 service nova] Creating event network-vif-plugged:0f3362f6-2e54-4b45-89fc-94c7ecae5a49 for instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 on hv-cinder-81883 Jan 27 16:49:21.752176 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d0414897-8a85-453c-a8ad-3470ad51ccc9 req-b57e1cf2-2203-476f-88db-f8ff42552f88 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 Jan 27 16:49:21.752779 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 54/113] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:21.787680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:21.788557 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:21.795156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.795828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.796617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.797053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.933613 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:21.943309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-edcb443a-11f2-4bf9-9d37-0c5fae21b83e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.159382 Jan 27 16:49:21.944553 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 60/114] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:21 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:21.977691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:21.978385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:21.985351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.985794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:21.986566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:21.986995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.113899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:22.114606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:22.116175 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.120942 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.121476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.122322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.122756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.124602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-171a8525-0229-4e7f-98c8-0b780c5d497e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.150707 Jan 27 16:49:22.125272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 55/115] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:21 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:22.262911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.270486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-db3bbf42-aab6-4219-9957-9253f4c0a64e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.160238 Jan 27 16:49:22.271036 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 61/116] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:22 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:22.458239 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:22.458842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:22.465115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.465568 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.466347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.466782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.586120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:22.586835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:22.597252 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.597694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.598835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.598930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.602029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.611782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.613266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.615077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cd15d306-fcd6-47e5-a6ca-1409c04003bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.160591 Jan 27 16:49:22.616220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 56/117] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:22 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:22.743465 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:22.750969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2a587afd-245c-4055-91fd-0e3eac83c319 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1318 microversion: 2.1 time: 0.168654 Jan 27 16:49:22.751543 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 62/118] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:22 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:22.961081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:22.961848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:22.967898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.968455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:22.969330 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:22.969765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.114075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.121967 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b429b54f-89de-4715-b49a-9b031ab166ad tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.164468 Jan 27 16:49:23.122623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 57/119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:22 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:23.141396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:23.141937 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:23.147822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.148269 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.149027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.149458 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.279134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.286776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0464511d-fda9-4b54-ac11-4d4d7df9c8da tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.149028 Jan 27 16:49:23.287682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 63/120] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:23 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:23.288143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:23.288764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:23.296568 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.297191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.298640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.299158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.607686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.625049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-442fe7b1-8124-4d7c-b60a-bbabd0dc9618 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.340942 Jan 27 16:49:23.626212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 58/121] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:23 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:23.633661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:23.634525 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:23.643746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.644561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.645434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.646508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.767437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:23.768414 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:23.775547 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.776241 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.777426 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:23.777961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:23.970413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.979552 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.981527 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:23.982682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-057072e9-d030-40e8-95a5-add96141ff56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.352681 Jan 27 16:49:23.983249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 64/122] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:23 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:24.004192 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:24.011541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-70ee07ac-c6d1-41d2-acdd-3612599df1a2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1508 microversion: 2.1 time: 0.247776 Jan 27 16:49:24.012141 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 59/123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:23 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:24.140565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:24.140565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:24.147389 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.148048 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.148997 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.150433 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.304527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:24.305137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:24.315887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.316872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.318211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.318895 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.320853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:24.328655 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-34e1c7fd-51e9-4605-9e72-4457c72c55d5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.194117 Jan 27 16:49:24.329942 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 65/124] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:24 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:24.618382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:24.630237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bae51dfa-e5f3-4485-b356-a6e092f9a1df tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1314 microversion: 2.1 time: 0.329391 Jan 27 16:49:24.643934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 60/125] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:24 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:24.647693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:24.648422 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:24.662412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.665540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.669582 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:24.670109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:24.897365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:24.908822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a9694ab5-13ac-4ca1-aef0-0be7bbfff641 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.269643 Jan 27 16:49:24.914716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 66/126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:24 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:25.001389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:25.002156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:25.009013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.009462 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.010839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.011289 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.158496 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:25.166471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:25.167997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:25.169102 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-66b488d6-fae7-492a-852f-4cb392fa519f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.171649 Jan 27 16:49:25.169655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 61/127] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:24 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:25.345765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:25.346697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:25.352702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.353152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.353988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.354504 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.509966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:25.520818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9fcf10fc-41b0-4124-a4bf-1119dbbb5d1d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.177712 Jan 27 16:49:25.522099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 67/128] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:25 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:25.555962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1239e1b8-fe8f-442e-aed5-dd90f1b6d047"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:25.557619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:25.564452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.565171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.566240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.566779 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.650040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:25.650806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:25.657375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.657827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.658648 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.659249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.823324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:25.830962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f869cd8b-a8df-4abd-ae21-4ce587ea68ed tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1501 microversion: 2.1 time: 0.184564 Jan 27 16:49:25.831538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 68/129] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:25 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:25.915353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5af4ff91-9338-4d68-a365-f04d7cda927a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362709 Jan 27 16:49:25.916124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 62/130] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:49:25 2022] POST /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:25.926203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:25.927148 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:25.934938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.935719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:25.936731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:25.937218 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:26.100720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:26.108702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a23237f2-8a76-4cb5-8662-435078ad304e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.186072 Jan 27 16:49:26.109606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 69/131] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:25 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:26.190299 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:26.191285 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:26.202595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:26.203144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:26.204197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:26.204942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:26.358824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:26.366498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:26.367993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:26.369088 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4bc1df07-3557-4d91-93bd-d45ec7060639 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.185987 Jan 27 16:49:26.370163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 63/132] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:26 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:26.538091 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:26.538705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:26.544722 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:26.545168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:26.546126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:26.546992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:26.697726 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:26.705235 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0a23be7a-29be-49ce-998d-e587a7064960 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.170833 Jan 27 16:49:26.705804 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 70/133] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:26 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:27.125538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:27.126197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:27.132958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.136228 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.137119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.137571 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.284169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:27.293857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b6eaa0db-530c-4070-8692-8614a8ab9ccf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.171932 Jan 27 16:49:27.294934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 64/134] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:27 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:27.388680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:27.389448 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:27.395382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.395873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.396662 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.397099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.580720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:27.589298 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:27.590786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:27.591926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fdad7ddd-558c-4943-b825-705784c7c7ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.208175 Jan 27 16:49:27.592491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 71/135] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:27 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:27.721903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:27.722723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:27.729612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.730306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.731252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:27.731984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:27.877301 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:27.887977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4f70cbb8-d3f4-4378-b05a-86387a72530b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.169471 Jan 27 16:49:27.898291 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 65/136] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:27 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:28.312677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:28.313361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:28.319216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.319807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:28.320661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.321167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:28.457866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:28.466099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-84a51b1a-901c-48bb-b188-abd6ca0fa2d4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.157201 Jan 27 16:49:28.466672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 72/137] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:28 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:28.609481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:28.610915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:28.620319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.620319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:28.620319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.620319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:28.766970 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:28.774792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:28.777794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:28.778927 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bb578fae-29ac-483e-8d65-2d9c8eb54b1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.173202 Jan 27 16:49:28.779513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 66/138] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:28 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:28.905116 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:28.905762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:28.911651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.912099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:28.912868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:28.913300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:29.037644 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:29.045625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e053a735-6b1f-4b1d-a7cd-810f47097a29 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.144191 Jan 27 16:49:29.046194 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 73/139] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:28 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:29.482685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:29.483210 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:29.489061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:29.489507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:29.490275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:29.490702 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:29.620975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:29.628312 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bddfb694-f12a-4edf-b332-ddf81c655cd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.150053 Jan 27 16:49:29.628880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 67/140] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:29 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:29.797695 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:29.798294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:29.804063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:29.804523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:29.805297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:29.805734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:29.932582 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:29.940223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:29.941737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:29.942821 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-118982dc-efa2-44c3-9696-e7a66a5b76f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.149105 Jan 27 16:49:29.943370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 74/141] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:29 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:30.062752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:30.063363 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:30.069523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.069970 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.070735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.071169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.203271 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:30.210423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9274e6a5-673f-4dbd-9075-fda44b7e1570 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.151391 Jan 27 16:49:30.210994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 68/142] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:30 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:30.645329 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:30.645891 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:30.651954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.652397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.653162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.653587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.759241 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "891372af-c0f8-42f6-ad97-64128a48efcf"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:30.760550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:30.767050 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.767606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.768503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.769008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.798304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:30.805839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a0c26236-c867-4cb6-852b-4c97b608a631 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.164272 Jan 27 16:49:30.806386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 75/143] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:30 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:30.961404 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:30.962061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:30.969010 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.969426 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:30.970206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:30.970635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:31.039290 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-586084b5-068c-43d7-b31b-b312cb371a5d tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "POST /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283501 Jan 27 16:49:31.040013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 69/144] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:49:30 2022] POST /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:31.132371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:31.140258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:31.141742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:31.142838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c2d2b8b9-9708-4ed0-8497-c794b18a1a66 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.185431 Jan 27 16:49:31.143381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 76/145] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:30 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:49:31.227635 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:31.228248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:31.234788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:31.235234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:31.236034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:31.236469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:31.367394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:31.375184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bd85c910-638a-4a45-bfab-fd5531edc5dc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.152026 Jan 27 16:49:31.375787 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 70/146] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:31 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:31.822053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:31.823352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:31.829167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:31.829614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:31.830380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:31.830811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:31.958086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:31.965992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2cfae779-6fae-4886-b155-a7a606e62c1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.147631 Jan 27 16:49:31.966561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 77/147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:31 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:32.160919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:32.161557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:32.167872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.168314 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:32.169082 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.169514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:32.295041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:32.303085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:32.304589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:32.305681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fa559890-f11a-4f7e-8b7c-f2611be2811b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.148450 Jan 27 16:49:32.306225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 71/148] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:32 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:32.391798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:32.392449 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:32.398238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.398688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:32.399735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.400177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:32.527257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:32.536092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-01945d00-0769-40d9-9f43-e97de67a3109 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.147897 Jan 27 16:49:32.536670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 78/149] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:32 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:32.983284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:32.983864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:32.990091 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.990534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:32.991304 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:32.991762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:33.117401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:33.124775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-db0c9afd-ed85-4e97-baa7-3aae6f91defb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.145947 Jan 27 16:49:33.125337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 72/150] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:32 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:33.324193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:33.324801 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:33.330588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:33.331034 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:33.332296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:33.332725 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:33.465120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:33.472830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:33.474321 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:33.475423 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9f646c79-8925-4505-8028-69070ea3a30d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.155726 Jan 27 16:49:33.476017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 79/151] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:33 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:33.552933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:33.553536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:33.559651 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:33.560093 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:33.560854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:33.561279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:33.685932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:33.693043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-73870593-7f2f-4ba2-82bd-7162fb1afdd3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.143718 Jan 27 16:49:33.693603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 73/152] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:33 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:34.140665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:34.141270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:34.147058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.147497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.148288 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.148717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.279627 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:34.286691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2ec6aa46-465f-45cc-bee3-13170d4e25ca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.149580 Jan 27 16:49:34.287262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 80/153] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:34 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:34.493349 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:34.494732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:34.501038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.501482 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.502253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.502682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.626875 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:34.634567 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:34.636696 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:34.637800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-db089f42-7a96-44e5-a262-bb30fa12d14f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.148248 Jan 27 16:49:34.638350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 74/154] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:34 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:34.710212 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:34.710753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:34.716716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.717154 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.717910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:34.718338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:34.846261 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:34.853794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9edf64ef-e554-4751-a36f-e34a5081d4b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.146747 Jan 27 16:49:34.854849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 81/155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:34 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:35.303390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:35.304023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:35.309879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.310329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:35.311104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.311546 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:35.449231 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:35.456660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-40291c94-5bd2-4473-8e70-31df550ac99f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.156704 Jan 27 16:49:35.457235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 75/156] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:35 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:35.655087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:35.655730 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:35.661331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.661774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:35.662542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.662971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:35.794254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:35.802028 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:35.803518 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:35.804710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-01dfd4c0-3c5c-48a5-bb3f-6093a07c8450 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.153275 Jan 27 16:49:35.805274 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 82/157] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:35 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:49:35.870602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:35.871751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:35.877944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.878325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:35.879133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:35.879557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.009926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:36.017004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6182fdef-4194-4ddd-8049-43a8fcac93d8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.150833 Jan 27 16:49:36.017565 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 76/158] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:35 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:36.474037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:36.474653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:36.481099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:36.481613 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.482383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:36.482809 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.504649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-3f9dcc6b-7577-4e99-8f77-75e93be2bbd8 req-58a4c44b-5581-469a-b4a8-28e2b559df8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "name": "network-vif-plugged", "status": "completed", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:36.506484 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:36.506484 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:36.513752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-3f9dcc6b-7577-4e99-8f77-75e93be2bbd8 req-58a4c44b-5581-469a-b4a8-28e2b559df8f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:36.514389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-3f9dcc6b-7577-4e99-8f77-75e93be2bbd8 req-58a4c44b-5581-469a-b4a8-28e2b559df8f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.644906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:36.653956 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-591c5e20-2aec-4690-b683-bb7c7ebe4ab1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.183483 Jan 27 16:49:36.654574 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 83/159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:36 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:36.666975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-3f9dcc6b-7577-4e99-8f77-75e93be2bbd8 req-58a4c44b-5581-469a-b4a8-28e2b559df8f service nova] Creating event network-vif-plugged:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:49:36.673253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-3f9dcc6b-7577-4e99-8f77-75e93be2bbd8 req-58a4c44b-5581-469a-b4a8-28e2b559df8f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172503 Jan 27 16:49:36.674384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 77/160] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:36.823665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:36.824356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:36.830532 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:36.834894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.834894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:36.834894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:36.967149 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:36.975715 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:36.977203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:36.979088 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2316de91-dd4f-4147-b677-5d4854235e1a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.158563 Jan 27 16:49:36.980022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 84/161] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:36 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:37.034526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:37.035269 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:37.041835 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:37.042275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:37.043177 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:37.043626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:37.170919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:37.178064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0ab12532-bf67-48f0-88af-66c4d19860c1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.147912 Jan 27 16:49:37.178622 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 78/162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:37 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:37.670040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:37.670673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:37.676398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:37.676840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:37.677607 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:37.678039 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:37.808366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:37.815491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f793fe0e-3c08-4006-87b5-710e26676af5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.149011 Jan 27 16:49:37.816077 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 85/163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:37 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:37.997417 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:37.998022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:38.004469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.004914 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.005740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.006172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.138800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:38.147298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:38.148975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:38.150477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6d6b6d55-ed98-4985-ba1e-ecde71d4bd12 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1405 microversion: 2.20 time: 0.156932 Jan 27 16:49:38.151060 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 79/164] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:37 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:38.194447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:38.195057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:38.201253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.201704 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.202480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.202916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.333391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:38.341330 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7ad43c17-bc3a-49f2-8669-59375948f564 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.150649 Jan 27 16:49:38.341899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 86/165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:38 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:38.692224 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5490cbd-3604-4065-b528-a305f9f211ce", "name": "network-vif-plugged", "status": "completed", "tag": "8e60561d-e86c-4bcf-b188-6be71158ac4e"}, {"server_uuid": "27dbabab-3baf-4446-aaad-bdd80b162cd7", "name": "network-vif-plugged", "status": "completed", "tag": "c7ee8f95-4b6c-4378-a74a-658d33610c09"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:38.694004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:38.694004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:38.701827 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.702270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.714652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] Creating event network-vif-plugged:8e60561d-e86c-4bcf-b188-6be71158ac4e for instance b5490cbd-3604-4065-b528-a305f9f211ce on hv-cinder-81883 Jan 27 16:49:38.715156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] Creating event network-vif-plugged:c7ee8f95-4b6c-4378-a74a-658d33610c09 for instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 on hv-cinder-81883 Jan 27 16:49:38.721384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-63d98257-1ce2-428d-8ca4-cbc3ccdce740 req-43a0627a-63b0-4324-b3c6-99746fa3e11a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032670 Jan 27 16:49:38.721960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 80/166] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:38.835501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:38.836266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:38.850491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.851090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:38.852492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:38.854025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.023343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:39.052218 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e9103902-425b-4453-899d-21fefa7943f9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.220153 Jan 27 16:49:39.053379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 87/167] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:38 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:39.170756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:39.171375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:39.178481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.179336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.180469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.180904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.362834 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:39.363518 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:39.377342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.377342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.378190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.378684 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.454319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:39.462480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:39.464320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:39.465668 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3fc70b97-ca90-41ce-a2ad-334616bb2a49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1597 microversion: 2.20 time: 0.300819 Jan 27 16:49:39.480830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 81/168] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:49:39 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1597 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:49:39.486407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:39.487445 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:39.505356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.506172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.507279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:39.507928 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:39.538988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:39.552158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1ebf2883-4741-483f-ae80-fc8b7011b136 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.191584 Jan 27 16:49:39.552691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 88/169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:39 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:39.608474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-717702d5-73af-4f21-96bf-d1d3c9c10eac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126327 Jan 27 16:49:39.609541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 82/170] 10.222.0.48 () {60 vars in 1315 bytes} [Thu Jan 27 16:49:39 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:49:39.906726 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162514687", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "e61a4ef3-534d-479d-8867-5085e7d92be1"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:39.970932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] validate_networks() for [('e61a4ef3-534d-479d-8867-5085e7d92be1', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:49:40.076267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:40.078622 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:40.086531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.087272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.088440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.089075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.391468 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:40.398988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c14f449e-e760-48be-9410-b19e6d229481 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.329764 Jan 27 16:49:40.400028 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:40 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:40.572005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:40.573078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:40.580317 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.580759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.581728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.582039 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.626322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:49:40.626896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:49:40.627646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:49:40.628290 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:49:40.628770 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:49:40.644755 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.646578 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.647688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:40.648585 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:40.685435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:49:40.690386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for user 3cfe4a71879849b581eb8b48b24107fd and project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:49:40.704765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:49:40.707234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:49:40.761382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c873e368-a4b8-4c92-995b-be0e10992698 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859386 Jan 27 16:49:40.767382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 89/172] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:49:40.772698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19736a8d-6c4c-4182-b29b-e54e0cd6861b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:40.773026 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:40.773769 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19736a8d-6c4c-4182-b29b-e54e0cd6861b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:40.783022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b4e0acc5-0275-4d53-8e60-0076e67cb9f9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.217424 Jan 27 16:49:40.793738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 84/173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:40 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:40.849245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-19736a8d-6c4c-4182-b29b-e54e0cd6861b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:40.862483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19736a8d-6c4c-4182-b29b-e54e0cd6861b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1217 microversion: 2.1 time: 0.093269 Jan 27 16:49:40.864092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 90/174] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:40 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:41.331060 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:41.332375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:41.342058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.344688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.346773 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.347420 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.352660 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-340eccd0-a57e-4b14-a6c8-31ef7ff6cff5 req-680301f1-c2e2-4f7e-86cd-c05c4261a259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:41.355011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:41.355011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:41.373103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-340eccd0-a57e-4b14-a6c8-31ef7ff6cff5 req-680301f1-c2e2-4f7e-86cd-c05c4261a259 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.373711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-340eccd0-a57e-4b14-a6c8-31ef7ff6cff5 req-680301f1-c2e2-4f7e-86cd-c05c4261a259 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.392612 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-340eccd0-a57e-4b14-a6c8-31ef7ff6cff5 req-680301f1-c2e2-4f7e-86cd-c05c4261a259 service nova] Creating event network-changed:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:49:41.401544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-340eccd0-a57e-4b14-a6c8-31ef7ff6cff5 req-680301f1-c2e2-4f7e-86cd-c05c4261a259 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054863 Jan 27 16:49:41.402226 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 91/175] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:41.419380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:41.420390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:41.431877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.432645 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.434467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.434995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.613648 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:41.631131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6f8d4e5c-ea9a-46d1-9e04-b608cb893394 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.218197 Jan 27 16:49:41.631751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 92/176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:41 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:41.800355 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:41.800966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:41.813152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.813688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.814785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:41.815504 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:41.977230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:41.985572 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-288d0304-cc86-4933-ab15-981166a1441a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.188596 Jan 27 16:49:41.986337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 93/177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:41 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:41.991472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:41.992110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:42.000587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:42.001044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:42.001873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:42.002310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:42.070009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:42.079790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-dfbac096-f66b-48a4-8ffa-716abeec702e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1221 microversion: 2.1 time: 0.092699 Jan 27 16:49:42.080994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 94/178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:41 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:42.647862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:42.648589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:42.661293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:42.661747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:42.662736 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:42.663177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:42.771831 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-eee04ea2-84ec-4d24-91c2-eafed89d0af8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 1.445057 Jan 27 16:49:42.775620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 85/179] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:41 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:42.871835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:42.879829 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1469f2c2-164d-4809-90b3-541554b326d1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.235312 Jan 27 16:49:42.880433 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 95/180] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:42 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:43.003213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:43.004303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:43.012165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.012464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.013244 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.013706 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.096539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:43.097376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:43.104302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.105125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.106076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.106756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.190282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:43.192181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:43.200488 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fdb9a376-3054-48ea-bf5d-d036bd1120a6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.201527 Jan 27 16:49:43.210736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 86/181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:42 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:43.213306 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ee3e3f03-bd5a-41e9-bc84-ab4f58563886 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1269 microversion: 2.1 time: 0.119738 Jan 27 16:49:43.214202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 96/182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:43 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:43.784415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:43.785912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:43.793799 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.794425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.795232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.795693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.898136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:43.900694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:43.914139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.914139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.914139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:43.914139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:43.930285 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ffcc0c27-0e58-4357-a83a-c344e89783de tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.149749 Jan 27 16:49:43.932821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 87/183] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:43 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:44.084184 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:44.092323 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7c9d5365-2c1f-4370-a36e-d6386385a2fb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1364 microversion: 2.1 time: 0.198902 Jan 27 16:49:44.092902 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 97/184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:43 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:44.219941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:44.221173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:44.230703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.230934 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:44.231522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:44.231697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:44.232620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.233351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:44.242568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.243036 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:44.246962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.247609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:44.542094 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:44.559866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-803c44a6-10cb-4104-a4b6-fb4af8e7f3a9 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1322 microversion: 2.1 time: 0.345550 Jan 27 16:49:44.560457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 88/185] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:44 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:44.575705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:44.582972 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-085474d4-eb68-4cb9-a180-093f39d3e073 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.356552 Jan 27 16:49:44.583854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 98/186] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:44 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:44.942466 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:44.943598 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:44.951464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.951946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:44.952727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:44.953323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.050058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-53c30854-4fd1-4188-98d6-455c8a368922 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.111116 Jan 27 16:49:45.053307 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 89/187] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:44 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:45.107919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:45.108540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:45.114663 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.115269 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.116264 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.116849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.124673 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-276d2243-db48-44ce-b02d-3ce9612dfba0 req-1a5a063b-8b98-470e-88c4-b718c302bb53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d239b7-dd50-4a27-9c01-93a05580e612", "tag": "18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:45.126174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:45.126174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:49:45.138051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-276d2243-db48-44ce-b02d-3ce9612dfba0 req-1a5a063b-8b98-470e-88c4-b718c302bb53 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.138727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-276d2243-db48-44ce-b02d-3ce9612dfba0 req-1a5a063b-8b98-470e-88c4-b718c302bb53 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.160478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-276d2243-db48-44ce-b02d-3ce9612dfba0 req-1a5a063b-8b98-470e-88c4-b718c302bb53 service nova] Creating event network-changed:18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716 for instance f1d239b7-dd50-4a27-9c01-93a05580e612 on hv-cinder-81883 Jan 27 16:49:45.166359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-276d2243-db48-44ce-b02d-3ce9612dfba0 req-1a5a063b-8b98-470e-88c4-b718c302bb53 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046154 Jan 27 16:49:45.166963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 90/188] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:45.270698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:45.278441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-43f1b8d8-776f-482f-9221-ebcee9f7e7d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1549 microversion: 2.1 time: 0.174222 Jan 27 16:49:45.279216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 99/189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:45 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:45.296164 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:45.296735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:45.302971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.303494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.304323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.304760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.388461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2d526385-dc1e-49e7-abd7-46ac1b3da1aa tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096718 Jan 27 16:49:45.389061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 91/190] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jan 27 16:49:45 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:45.579456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:45.580266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:45.589690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.590087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.591139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.591954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.601211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:45.602656 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:45.612526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.613176 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:45.614072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:45.614752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.059434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:46.066958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6850611f-4973-49a1-8607-45963992d723 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1516 microversion: 2.1 time: 0.491710 Jan 27 16:49:46.067781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 100/191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:45 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1516 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:46.073352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:46.074515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:46.075636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:46.082280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.083237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.084227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.084838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.085500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-653012a7-ac95-4885-b276-fd2b01fe3637 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.489701 Jan 27 16:49:46.086235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 92/192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:45 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:46.102868 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:46.104005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:46.111111 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.112101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.112906 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.113672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.145296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lazy-loading 'flavor' on Instance uuid b5490cbd-3604-4065-b528-a305f9f211ce {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:49:46.272127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-04a1cd35-073f-40dd-8687-91437b0fdb56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.202826 Jan 27 16:49:46.273790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 101/193] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:46 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:46.303346 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-21b90e8d-8706-4f25-804b-4137c171440c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce/action" status: 200 len: 32 microversion: 2.1 time: 0.205560 Jan 27 16:49:46.303991 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 93/194] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:46 2022] POST /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce/action => generated 32 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:46.314390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:46.324652 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:46.333187 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.334634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.335845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:46.336282 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:46.903546 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:46.911175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-507bfc57-2099-4c46-90ad-4b2111339ebc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.600814 Jan 27 16:49:46.911772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 102/195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:46 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:47.104424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:47.105129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:47.111719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.112166 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.112939 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.113367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.286262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:47.288622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:47.297172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.298021 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.301084 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.301976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.341781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:47.349800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f7a56507-40b1-4185-a77a-cffd845c1240 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.250359 Jan 27 16:49:47.350382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 94/196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:47 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:47.389528 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5f3273ba-0963-4f6a-b26d-02779908b533 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.106653 Jan 27 16:49:47.390633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 103/197] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:47 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:47.507608 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:47.508738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:47.516570 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-5417aca5-66d1-40fb-ae37-07f9de7b1c2a req-63b2183d-b205-4abe-bcce-3f7be87652d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dbabab-3baf-4446-aaad-bdd80b162cd7", "tag": "c7ee8f95-4b6c-4378-a74a-658d33610c09"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:47.525825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:47.525825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:47.538178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.538630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.539421 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.539884 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.543380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5417aca5-66d1-40fb-ae37-07f9de7b1c2a req-63b2183d-b205-4abe-bcce-3f7be87652d3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.543862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5417aca5-66d1-40fb-ae37-07f9de7b1c2a req-63b2183d-b205-4abe-bcce-3f7be87652d3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.573458 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-5417aca5-66d1-40fb-ae37-07f9de7b1c2a req-63b2183d-b205-4abe-bcce-3f7be87652d3 service nova] Creating event network-changed:c7ee8f95-4b6c-4378-a74a-658d33610c09 for instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 on hv-cinder-81883 Jan 27 16:49:47.587705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-5417aca5-66d1-40fb-ae37-07f9de7b1c2a req-63b2183d-b205-4abe-bcce-3f7be87652d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072224 Jan 27 16:49:47.588570 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 104/198] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:49:47.650500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-214986a0-0843-48bd-9cad-3063c8506550 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.146572 Jan 27 16:49:47.653634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 95/199] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:47 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:47.929543 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:47.930597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:47.951462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.952312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:47.953350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:47.954016 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.349566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:48.364318 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5f418749-aeea-44c5-85e1-95535651b9e7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.437800 Jan 27 16:49:48.365112 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 105/200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:47 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:48.366809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:48.367502 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:48.384510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.385168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.388605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.392186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.401649 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:48.402850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:48.418297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.432379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.437300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.441294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.571665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-373194b1-83fa-4281-9265-61e16259e5ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.170966 Jan 27 16:49:48.572968 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 106/201] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:48 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:48.662401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:48.663411 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:48.683510 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.694870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.698258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:48.698962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:48.745188 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:48.775785 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-819040d3-0aa4-4932-b9df-6d16c1e13735 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.408720 Jan 27 16:49:48.776410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 96/202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:48 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:48.830283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ac60470e-284f-48be-8222-020b44e9b0ae tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.171929 Jan 27 16:49:48.835479 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 107/203] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:48 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:49:49.382731 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:49.383650 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:49.392056 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.403166 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.404380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.405165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.562329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:49.570263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-317b9cc7-94ef-4189-aa3e-36e5e9632580 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.191691 Jan 27 16:49:49.570984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 97/204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:49 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:49.583463 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:49.584568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:49.593805 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.594189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.595750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.596368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.714945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-12408fbf-1f45-40db-8714-5204a5db2a2b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.136007 Jan 27 16:49:49.719190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 108/205] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:49 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:49.792978 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:49.793723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:49.799883 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.800444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.801347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.801880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.845305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:49.846778 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:49.858076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.858719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.859689 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:49.860395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:49.982201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e6bfe855-86ab-4e1f-993a-36c54086c79e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.142860 Jan 27 16:49:49.983113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 109/206] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:49 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:50.002688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:50.011606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b7292822-7188-4fa4-b41d-41bd1815df46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.222926 Jan 27 16:49:50.020997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 98/207] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:49 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:50.336123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:50.336707 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:50.347703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.348199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.349336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.349777 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.377826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:49:50.489897 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b39ad64f-7a4f-42c6-90bb-d591b065b51a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 204 len: 0 microversion: 2.1 time: 0.157585 Jan 27 16:49:50.490542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 110/208] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:49:50 2022] DELETE /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:49:50.502404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:50.503398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:50.510665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.511179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.512092 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.512464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.589236 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:50.590083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:50.597853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.598540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.599512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.600137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.702498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:50.722947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-588cae30-ec0f-4414-aa88-b597ad2135f8 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1553 microversion: 2.1 time: 0.225579 Jan 27 16:49:50.733185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 99/209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:50 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:50.733185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:50.733185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:50.737853 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.738458 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.740051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:50.740703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:50.769274 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:50.776894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fa767b09-faf5-402a-869d-58dd53b74b4f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.192703 Jan 27 16:49:50.777472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 111/210] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:50 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:50.858440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-97756af3-3709-4c8a-9e48-c854d09b11dd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.131723 Jan 27 16:49:50.859069 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 100/211] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:50 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:50.992620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:50.993776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:51.000005 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.000462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.001239 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.001676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.031075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:51.032034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:51.039381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.039925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.041140 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.041667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.115498 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4f84affc-107f-441d-84ff-64a1447fba3b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.126244 Jan 27 16:49:51.116313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 112/212] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:50 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:51.186126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:51.194947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-106a2bb3-3394-4ed0-a7ca-0e1f68663183 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.169059 Jan 27 16:49:51.195514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 101/213] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:51 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:51.743051 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:51.744305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:51.751770 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.752223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.753197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.753633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.793679 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:51.794345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:51.801344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.801798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.802596 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.803037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.930403 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:51.940040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0592ac60-8f3a-40cf-89fe-e8cf083396a9 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1553 microversion: 2.1 time: 0.202360 Jan 27 16:49:51.940853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 113/214] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:51 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:51.957466 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:51.958588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:51.965179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.965636 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.966424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:51.966859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:51.978660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:51.986905 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-465aea7f-6382-4543-9a75-a1b904b4a15f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.196923 Jan 27 16:49:51.987821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 102/215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:51 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:52.057417 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2eb4453d-7341-40da-ba9d-637a9d578229 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.103153 Jan 27 16:49:52.059305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 114/216] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:51 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:52.127739 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:52.128763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:52.135522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.136103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:52.137024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.137541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:52.215180 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:52.216064 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:52.216618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ce350705-5254-48c1-a98c-52b60edf2d1c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.092351 Jan 27 16:49:52.217260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 103/217] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:52 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:52.223793 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.224247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:52.225040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.225478 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:52.375064 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:52.382334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7eac83ab-e8b4-4f77-8e77-b3a13eab6976 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.172094 Jan 27 16:49:52.383105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 115/218] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:52 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:52.960565 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:52.961266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:52.968740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.969275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:52.970327 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:52.970817 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.006038 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:53.006934 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:53.013809 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.014391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.015283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.016138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.161810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:53.172773 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-66261719-e3b5-47cf-8397-49b4b753038a tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1553 microversion: 2.1 time: 0.216060 Jan 27 16:49:53.173774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 104/219] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:52 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1553 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:53.178665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:53.179922 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:53.186984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.188067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.188864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.189300 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.226725 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:53.234223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b7fc39fc-3772-4ecf-a2e9-bedf2b6f26b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.231776 Jan 27 16:49:53.234888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 116/220] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:53 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:53.239492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:53.240558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:53.246999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.247536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.248438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.248960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.281972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c3688294-c67a-4c89-9f38-c1fe794badb4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.106489 Jan 27 16:49:53.282759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 105/221] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:53 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:53.355480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7b6c0b5b-8ff2-4ab9-b0ed-a5f3b70ec0a8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.119231 Jan 27 16:49:53.356308 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 117/222] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:53 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:53.398653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:53.402917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:53.410053 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.410549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.411336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.412150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.552464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:53.561033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1565003f-b6f0-4640-83d2-95d19e24a4d0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.166255 Jan 27 16:49:53.561611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 106/223] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:53 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:53.901399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-8576d00e-ac16-42ec-a21b-51702561e36c req-f559bf09-89d3-422f-bdf6-f2481e415583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d239b7-dd50-4a27-9c01-93a05580e612", "name": "network-vif-plugged", "status": "completed", "tag": "18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:53.907337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:53.907337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:53.920676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8576d00e-ac16-42ec-a21b-51702561e36c req-f559bf09-89d3-422f-bdf6-f2481e415583 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:53.921857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8576d00e-ac16-42ec-a21b-51702561e36c req-f559bf09-89d3-422f-bdf6-f2481e415583 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:53.939590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-8576d00e-ac16-42ec-a21b-51702561e36c req-f559bf09-89d3-422f-bdf6-f2481e415583 service nova] Creating event network-vif-plugged:18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716 for instance f1d239b7-dd50-4a27-9c01-93a05580e612 on hv-cinder-81883 Jan 27 16:49:53.945923 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-8576d00e-ac16-42ec-a21b-51702561e36c req-f559bf09-89d3-422f-bdf6-f2481e415583 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050367 Jan 27 16:49:53.947977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 118/224] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:54.200640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:54.202030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:54.210052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.210890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.213497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.214242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.251480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:54.252837 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:54.260687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.261687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.262679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.263377 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.298173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:54.308396 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6e28b92a-dc00-493e-8473-09e3d5913d3e tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1511 microversion: 2.1 time: 0.117221 Jan 27 16:49:54.312133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 107/225] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:54 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1511 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:54.327750 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:54.328909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:54.335934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.336652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.338481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.338912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.430411 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:54.438675 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-efe09ad8-0d81-4457-8953-26c7f378a22e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.191411 Jan 27 16:49:54.439255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 119/226] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:54 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:54.443578 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-b20c44ae-a7ed-43a6-aa25-981defc0e45e req-1978303f-cff3-4d9f-8231-534128b7251d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d62e6-6196-4c6f-ba02-dcf3fece8937", "name": "network-vif-deleted", "tag": "2d2494c4-b7fe-4dc9-8d66-cb83f755ac04"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:54.445076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:49:54.445076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:49:54.452384 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b20c44ae-a7ed-43a6-aa25-981defc0e45e req-1978303f-cff3-4d9f-8231-534128b7251d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.452762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b20c44ae-a7ed-43a6-aa25-981defc0e45e req-1978303f-cff3-4d9f-8231-534128b7251d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.599868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-b20c44ae-a7ed-43a6-aa25-981defc0e45e req-1978303f-cff3-4d9f-8231-534128b7251d service nova] Creating event network-vif-deleted:2d2494c4-b7fe-4dc9-8d66-cb83f755ac04 for instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 on hv-cinder-81883 Jan 27 16:49:54.607163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-b20c44ae-a7ed-43a6-aa25-981defc0e45e req-1978303f-cff3-4d9f-8231-534128b7251d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166654 Jan 27 16:49:54.607810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 120/227] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:49:54.612861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:54.613845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:54.619925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.620358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.621249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.621693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.703333 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5ef3783f-aeac-4fec-9a81-a473b501109b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.382792 Jan 27 16:49:54.703932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 108/228] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:54 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:54.708715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:54.709395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:54.716621 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.717062 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.717820 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:54.718244 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:54.735164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8af8c4aa-3620-4416-8ef0-2cd535cb6397 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.125823 Jan 27 16:49:54.737414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 121/229] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:54 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:49:54.857587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:54.865005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8c2aaae3-7ce1-428d-b86e-7c5236072be8 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.159938 Jan 27 16:49:54.865571 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 109/230] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:54 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:55.327009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:55.327759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:55.334947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.335402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.336232 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.336791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.369911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.370358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.370815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lazy-loading 'fault' on Instance uuid 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:49:55.415874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe12b69fda1e4bb0953ec32f2f8d4864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8930d227a39349b8a900ed8395fb7d2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:55.423855 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ea56dde4-cd85-4d25-b90a-bb96339b1b5f tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 200 len: 1350 microversion: 2.1 time: 0.100792 Jan 27 16:49:55.424418 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 122/231] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:55 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:49:55.456814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:55.457431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:55.465177 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.465789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.466742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.467318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.603121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:55.610600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c656ea75-6042-4faf-a058-550f2f671642 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.158023 Jan 27 16:49:55.611152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 110/232] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:55 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:55.717388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:55.718315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:55.725296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.725756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.726542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.726989 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.747253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:55.748260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:55.754061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.754500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.755472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.756071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.841454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e7ddb7a4-afbb-4385-8a63-a79850804be8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.129606 Jan 27 16:49:55.844896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 123/233] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:55 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:55.871911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c4b3e7df-fa85-428c-acc9-e8329296ee72 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.129167 Jan 27 16:49:55.875947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 111/234] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:55 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:49:55.886550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:55.886550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:55.893396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.893851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:55.894638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:55.895077 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.047269 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:56.055179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f1180572-f906-4c3a-8bb9-5e0b3a2972c5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1317 microversion: 2.1 time: 0.176166 Jan 27 16:49:56.056395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 124/235] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:55 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:56.442336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:56.443045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:56.450887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.451330 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.452159 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.452583 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.469163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] HTTP exception thrown: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. Jan 27 16:49:56.469774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Returning 404 to user: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:49:56.470584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-27950672-761a-4fe0-9ec2-ec838d8d3989 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 404 len: 111 microversion: 2.1 time: 0.032341 Jan 27 16:49:56.471140 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 112/236] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:56 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:49:56.578579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:56.579501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:56.586141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.586587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.587533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.588022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.600888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] HTTP exception thrown: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. Jan 27 16:49:56.601735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Returning 404 to user: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:49:56.603166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fa765f1a-d3d5-4cf5-83b8-fea72736bffe tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027621 Jan 27 16:49:56.603919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 125/237] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:49:56 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:49:56.627963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:56.628644 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:56.635348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.635907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.636912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.637353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.784768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:56.792522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6eefa735-281a-4307-8af9-42915af77db5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.168442 Jan 27 16:49:56.793397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 113/238] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:56 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:56.853185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:56.854349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:56.860792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.861248 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.862127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.862567 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.886349 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:56.887475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:56.894300 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.894904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:56.896020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:56.896557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.385026 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3ede82ec-b379-42fb-92a7-40997ef5ca58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 2.505263 Jan 27 16:49:59.385700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 114/239] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:49:56 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 2507 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:49:59.390277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:59.390998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:59.391305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a4406edc-7174-4a6e-9467-9a285570aaaa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 2.542487 Jan 27 16:49:59.392062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 126/240] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:49:56 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:59.396999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:59.397695 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:59.398002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.398795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.400325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.400763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.405526 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.405970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.406780 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.407237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.598760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:59.602886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:49:59.607120 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-529f1b89-43a5-4e96-92dc-bff08199bac1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1508 microversion: 2.1 time: 0.220402 Jan 27 16:49:59.607720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 115/241] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:59 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:59.610703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3e2886a9-4f45-4ece-9a71-215828875a5a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.217427 Jan 27 16:49:59.611264 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 127/242] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:49:59 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:49:59.624905 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1239e1b8-fe8f-442e-aed5-dd90f1b6d047"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:49:59.626145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:59.632088 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.632534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.633318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.633757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.710471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Invalid volume: volume 1239e1b8-fe8f-442e-aed5-dd90f1b6d047 is already attached to instances: 2a0a7f18-d314-4368-bed8-cb27c0ba466b Jan 27 16:49:59.711059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 400 to user: Invalid volume: volume 1239e1b8-fe8f-442e-aed5-dd90f1b6d047 is already attached to instances: 2a0a7f18-d314-4368-bed8-cb27c0ba466b {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:49:59.712308 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-43c8c892-47b1-4e6e-9dd5-8c5edd765a9b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091102 Jan 27 16:49:59.712919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 116/243] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:49:59 2022] POST /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 27 16:49:59.770226 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:49:59.770717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:49:59.777124 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.777574 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.778342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:49:59.778772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:49:59.899225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'services' on Instance uuid 2a0a7f18-d314-4368-bed8-cb27c0ba466b {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:50:00.011553 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-807a196e-86b5-46fa-b68c-ba16d8b3a07f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments/1239e1b8-fe8f-442e-aed5-dd90f1b6d047" status: 202 len: 0 microversion: 2.1 time: 0.244749 Jan 27 16:50:00.012441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 128/244] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:49:59 2022] DELETE /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments/1239e1b8-fe8f-442e-aed5-dd90f1b6d047 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:00.020245 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:00.021211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.029783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.030226 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.031249 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.031722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.063991 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bd5bb773-c6a0-4775-9123-926f27255acb tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Jan 27 16:50:00.064557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 117/245] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:00 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:00.397366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:00.398429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.401856 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:00.402758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.405263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.405686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.406469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.406906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.408476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.408943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.409709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.410136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.513934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3ca44f9a-635d-47b2-846e-d5bf781a7c26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 14 microversion: 2.20 time: 0.115956 Jan 27 16:50:00.514566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 118/246] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:00 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:00.519856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-88ffcbf6-38ec-4281-80dc-6896e7cb6c67 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.126784 Jan 27 16:50:00.520485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 129/247] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:00 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:50:00.628771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:00.629461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.637034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.637475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.638279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.638709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.784594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:00.793470 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-761a8d66-88aa-46ef-812d-8d168d787794 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.168823 Jan 27 16:50:00.794045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 119/248] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:00 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:00.939610 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:00.940273 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.947796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.948246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.949033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.949470 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.963957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] HTTP exception thrown: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. Jan 27 16:50:00.964696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Returning 404 to user: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:50:00.965617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c66b22f0-d321-4af5-8a8c-68caef35e192 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 404 len: 111 microversion: 2.1 time: 0.030862 Jan 27 16:50:00.966245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 130/249] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:50:00 2022] DELETE /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:50:00.973753 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:00.974404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] [instance: 8b9d62e6-6196-4c6f-ba02-dcf3fece8937] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:00.981434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.981881 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.982659 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:00.983091 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:00.996628 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] HTTP exception thrown: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. Jan 27 16:50:00.997220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] Returning 404 to user: Instance 8b9d62e6-6196-4c6f-ba02-dcf3fece8937 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:50:00.998042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2e38e62d-092f-450c-8327-96e4f1e13f91 tempest-DeleteServersTestJSON-1091574485 tempest-DeleteServersTestJSON-1091574485-project] 10.222.0.48 "GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937" status: 404 len: 111 microversion: 2.1 time: 0.027859 Jan 27 16:50:00.998580 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 120/250] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:00 2022] GET /compute/v2.1/servers/8b9d62e6-6196-4c6f-ba02-dcf3fece8937 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:50:01.076519 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:01.077906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:01.083644 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.084098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:01.084881 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.085316 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:01.116417 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-20214509-ea5c-41ce-9236-deae71f71372 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Jan 27 16:50:01.117208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 131/251] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:01 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:01.526434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:01.527901 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:01.531331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:01.532766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:01.535350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.535813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:01.536833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.537260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:01.539300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.540026 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:01.541062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:01.542131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:04.071497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d71bc100-101a-423f-b811-11fd48ad1903 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 9182 microversion: 2.20 time: 2.549781 Jan 27 16:50:04.072196 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 121/252] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:01 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 9182 bytes in 2552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:50:04.077006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:04.077687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:04.083748 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:04.084192 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:04.084954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:04.085382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:04.098901 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fe8065d4-66c0-4772-a051-bddc72636204 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 2.572143 Jan 27 16:50:04.099536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 132/253] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:01 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:50:04.104659 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:04.105642 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:04.112568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:04.113017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:04.113788 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:04.114222 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:04.144732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-87f1a031-5488-4bca-9ed4-8927eeefc089 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043955 Jan 27 16:50:04.145284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 133/254] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:04 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:04.218826 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:04.227064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4087a874-65f5-438b-b9ae-771d07c13c05 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.153758 Jan 27 16:50:04.228001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 122/255] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:04 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:05.083314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:05.084308 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:05.092293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.092742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.093600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.094031 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.109972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:05.110990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:05.117397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.118730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.119527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.119990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.195469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-98edc6e8-b5b9-441c-a80b-d48890b2ac59 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 12572 microversion: 2.20 time: 0.116170 Jan 27 16:50:05.197589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 134/256] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:05 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 12572 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:05.201428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:05.202400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:05.209147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.209603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.210347 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.210775 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.231382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a34e1c55-16e8-445b-bcd7-9dcceca3ac7e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.125010 Jan 27 16:50:05.234735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 123/257] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:05 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:50:05.241663 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-caf30a67-fa40-46f6-86ef-b36ac9b1cb88 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043934 Jan 27 16:50:05.242243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 135/258] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:05 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:50:05.244932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:05.245630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:05.252971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.253422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.254212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:05.254646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:05.396218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:05.399521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-746178233", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "e61a4ef3-534d-479d-8867-5085e7d92be1"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:05.405083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-067606e2-98d2-4d31-bb2d-5a8ed6f26431 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.164232 Jan 27 16:50:05.405656 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 124/259] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:05 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:05.452000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] validate_networks() for [('e61a4ef3-534d-479d-8867-5085e7d92be1', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:50:06.011870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:50:06.012363 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:50:06.012940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:50:06.013353 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:50:06.013781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:50:06.022391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.022840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.023982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.024429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.042488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:50:06.046940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for user 3cfe4a71879849b581eb8b48b24107fd and project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:50:06.061611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:50:06.064023 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:50:06.112579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-08c007b0-287e-4067-b360-4c3a80d52237 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717635 Jan 27 16:50:06.113271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 136/260] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:50:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:50:06.123557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3c9f4ed5-fb22-4186-aa93-c70cf9b89b33 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:06.124192 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3c9f4ed5-fb22-4186-aa93-c70cf9b89b33 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:06.185209 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3c9f4ed5-fb22-4186-aa93-c70cf9b89b33 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:06.194181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3c9f4ed5-fb22-4186-aa93-c70cf9b89b33 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1217 microversion: 2.1 time: 0.074373 Jan 27 16:50:06.194996 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 125/261] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:06 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:06.207258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:06.208580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:06.222928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.223382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.224250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.224619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.243724 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:06.244675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:06.256533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.256890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.257840 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.258408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.340677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-adfe82aa-e26b-42e6-ac7a-197d6086b254 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 15480 microversion: 2.20 time: 0.137323 Jan 27 16:50:06.342373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 137/262] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:06 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 15480 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:06.360534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4eb76e94-739d-4433-bec4-425a89a7b33d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 14 microversion: 2.1 time: 0.121839 Jan 27 16:50:06.363793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 126/263] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:06 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:50:06.423238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:06.424549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:06.442671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.443230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.444020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:06.444467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:06.597367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:06.606630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b26899ca-1522-4a78-aa7d-e32e5399ace1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.187584 Jan 27 16:50:06.607211 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 138/264] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:06 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:07.213419 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:07.214211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:07.221695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.222168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.222949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.223383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.299850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:07.312341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c27a2825-d6cf-40e4-988d-4286b8db48c1 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1269 microversion: 2.1 time: 0.103318 Jan 27 16:50:07.312952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 127/265] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:07 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:07.352475 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:07.353605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:07.361224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.361728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.362529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.362968 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.373953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:07.375338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:07.393158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.394001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.394980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.395631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.456863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7cca149d-89ca-4094-9a73-691bb0afcc56 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 17602 microversion: 2.20 time: 0.108458 Jan 27 16:50:07.458232 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 139/266] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:07 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 17602 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:07.504926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4b7c3daa-4863-4b60-a181-77f5ff4a04ff tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 4107 microversion: 2.1 time: 0.136288 Jan 27 16:50:07.507751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 128/267] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:07 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 4107 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:07.624458 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:07.625158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:07.632312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.649490 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.650581 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:07.650946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:07.958845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:07.970249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2d62ed41-dafd-4606-a0a4-21c3072531fd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.349500 Jan 27 16:50:07.970709 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 140/268] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:07 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:08.332577 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:08.333303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:08.348001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.348345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.353270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.353728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.469722 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:08.470735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:08.487857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.487857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.487857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.488650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.624651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25046627-83cd-4bd9-af19-71f31aedeb5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 17602 microversion: 2.20 time: 0.158778 Jan 27 16:50:08.625782 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 141/269] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:08 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 17602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:08.631216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:08.633106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:08.644945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.650995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.653543 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.655888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.711537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:08.719401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cfc41526-dde4-4dc4-a3b5-0cad59af1ccd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.392762 Jan 27 16:50:08.724917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 129/270] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:08 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:08.788005 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-38ff4fbb-9fc9-4c3d-9f7a-5ac07eb38401 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 8992 microversion: 2.1 time: 0.160627 Jan 27 16:50:08.788976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 142/271] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:08 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 8992 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:08.990985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:08.991699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:08.997926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.998652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:08.999440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:08.999976 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.146157 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:09.157390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9aa6d5f0-4606-4325-8732-0e8d03756f0b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.173568 Jan 27 16:50:09.168014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 130/272] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:08 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:09.325489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-f6c4c1b8-f163-42c3-9b56-df403505268d req-32c287f4-c3a9-4a8e-9b52-6daa69cc2bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60f03e7b-7a84-4810-9b70-efe8c671c055", "tag": "b1c27e4d-7b4f-4ebe-a3ea-28060834be45"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:09.329170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:50:09.329170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:50:09.342197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-f6c4c1b8-f163-42c3-9b56-df403505268d req-32c287f4-c3a9-4a8e-9b52-6daa69cc2bf6 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.342526 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-f6c4c1b8-f163-42c3-9b56-df403505268d req-32c287f4-c3a9-4a8e-9b52-6daa69cc2bf6 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.358787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-f6c4c1b8-f163-42c3-9b56-df403505268d req-32c287f4-c3a9-4a8e-9b52-6daa69cc2bf6 service nova] Creating event network-changed:b1c27e4d-7b4f-4ebe-a3ea-28060834be45 for instance 60f03e7b-7a84-4810-9b70-efe8c671c055 on hv-cinder-81883 Jan 27 16:50:09.363584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-f6c4c1b8-f163-42c3-9b56-df403505268d req-32c287f4-c3a9-4a8e-9b52-6daa69cc2bf6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046063 Jan 27 16:50:09.364185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 143/273] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:09.639006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:09.640096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:09.647147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.647806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.649604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.650334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.745319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c89d4d42-e6c8-4c78-8591-71c7bce6ef4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 19342 microversion: 2.20 time: 0.111803 Jan 27 16:50:09.745956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 131/274] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:09 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 19342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:09.756463 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:09.761170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:09.765722 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.766247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.767161 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.767694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.800104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:09.801386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:09.820237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.832454 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.833716 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:09.834308 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:09.948512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:09.956057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-09d8e273-c1d1-4113-a6dd-3b22d70a6cb3 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.217523 Jan 27 16:50:09.956624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 144/275] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:09 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:09.973100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-94d721c2-69a7-41e5-aa49-8bd2ca67f987 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 12548 microversion: 2.1 time: 0.176843 Jan 27 16:50:09.974003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 132/276] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:09 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 12548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:10.173948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:10.174881 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:10.182072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.182823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.183654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.184095 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.326314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:10.333497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-71d23dc8-52f2-4569-ad0f-49b49e397ddb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.163149 Jan 27 16:50:10.334281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 145/277] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:10 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:10.756938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:10.758277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:10.765476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.766033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.766923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.767426 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.897125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f936814a-f53f-4b1e-bdee-acba650d13d5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 19539 microversion: 2.20 time: 0.144324 Jan 27 16:50:10.899823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 133/278] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:10 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 19539 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:10.973125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:10.973892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:10.981437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.982019 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.982946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.983620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.984278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:10.985433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:10.991755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.992208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:10.993367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:10.993919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:11.107645 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f4e8f70b-63ca-4816-8179-4bbb110e15f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 15025 microversion: 2.1 time: 0.127174 Jan 27 16:50:11.111467 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 134/279] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:10 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 15025 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:11.129680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:11.137191 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0862c551-03d7-4fa7-bc0e-4a19c3b7c522 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.167630 Jan 27 16:50:11.137869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 146/280] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:10 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:11.350923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:11.352077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:11.359101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:11.359546 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:11.360708 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:11.361142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:11.502512 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:11.510513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-13c393c3-f68f-4946-9ec3-9734c6e5d410 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.163634 Jan 27 16:50:11.511283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 135/281] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:11 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:11.910113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:11.911244 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:11.919363 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:11.920783 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:11.921592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:11.922034 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.028465 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c38e8c67-4628-4fc3-8db5-2e0bbb4a18ae tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 21451 microversion: 2.20 time: 0.121945 Jan 27 16:50:12.029096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 147/282] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:11 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 21451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:12.119490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:12.120559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:12.126699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.127145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.128086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.128523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.154687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:12.155388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:12.162539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.162993 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.163799 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.164309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.255737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-79907361-8549-4fd2-9dfb-1f6cf406c5d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 17602 microversion: 2.1 time: 0.140412 Jan 27 16:50:12.256356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 136/283] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:12 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 17602 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:12.303076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:12.311288 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-74b7adc2-d180-41fd-ac7b-a0ec9d51801a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.160615 Jan 27 16:50:12.311964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 148/284] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:12 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:12.529001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:12.529813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:12.543804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.544256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.545040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:12.545476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:12.715416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:12.724493 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8b24b4ef-3f3e-40d0-b515-fb7e8956efcb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.199588 Jan 27 16:50:12.725329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 137/285] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:12 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:13.040387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:13.041309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:13.047994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.048401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.049305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.049737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.141913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6e09ccf3-60eb-4c2d-b575-1a1c3747f466 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 22213 microversion: 2.20 time: 0.105412 Jan 27 16:50:13.145880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 149/286] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:13 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 22213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:13.269397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:13.271738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:13.280386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.280907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.281912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.282388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.328989 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:13.330413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:13.339386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.340511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.341501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.342119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.371779 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-27dd81d9-8537-4e19-bab6-8b383448df8f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 17602 microversion: 2.1 time: 0.107777 Jan 27 16:50:13.372608 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 138/287] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:13 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 17602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:13.494008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:13.501449 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b95ce041-9b1e-4e22-b0e0-2f4780c64b7f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.177595 Jan 27 16:50:13.502020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 150/288] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:13 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:13.743864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:13.744847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:13.752162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.753532 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.754480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:13.755011 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:13.957531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:13.965223 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5e7eecfa-05d0-477b-96c8-d72d2f66f9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.226020 Jan 27 16:50:13.965880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 139/289] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:13 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:14.156737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:14.157668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:14.165683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.166166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.167144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.167593 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.281682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a104c9ce-dcfa-46ba-9d22-1e2cbcbd5ced tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 23131 microversion: 2.20 time: 0.131610 Jan 27 16:50:14.285388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 151/290] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:14 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 23131 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:14.389223 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:14.390158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:14.396591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.397034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.398007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.399338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.488348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1cc63740-e365-42d2-b016-090977c3c66a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 19342 microversion: 2.1 time: 0.108239 Jan 27 16:50:14.489819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 140/291] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:14 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 19342 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:14.518676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:14.519262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:14.528143 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.528625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.529427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.529870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.670403 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:14.678313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f493b754-6bd5-4d1b-9744-8e871380e87e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.163629 Jan 27 16:50:14.678807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 152/292] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:14 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:14.982251 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:14.983037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:14.990103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.990634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:14.991488 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:14.992592 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.136570 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:15.144273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4da02ad0-a969-49be-89a7-714728902bda tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.165999 Jan 27 16:50:15.144897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 141/293] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:14 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:15.270586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-485c9aff-e1cd-490a-a9ee-8d2cfa38a00e req-308187b4-710c-4770-bb90-ef7d4b0fefc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f03e7b-7a84-4810-9b70-efe8c671c055", "name": "network-vif-plugged", "status": "completed", "tag": "b1c27e4d-7b4f-4ebe-a3ea-28060834be45"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:15.275181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:50:15.275181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:50:15.293853 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:15.294852 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:15.301255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-485c9aff-e1cd-490a-a9ee-8d2cfa38a00e req-308187b4-710c-4770-bb90-ef7d4b0fefc5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.310529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-485c9aff-e1cd-490a-a9ee-8d2cfa38a00e req-308187b4-710c-4770-bb90-ef7d4b0fefc5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.310620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.310620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.312044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.316776 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.324564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-485c9aff-e1cd-490a-a9ee-8d2cfa38a00e req-308187b4-710c-4770-bb90-ef7d4b0fefc5 service nova] Creating event network-vif-plugged:b1c27e4d-7b4f-4ebe-a3ea-28060834be45 for instance 60f03e7b-7a84-4810-9b70-efe8c671c055 on hv-cinder-81883 Jan 27 16:50:15.339367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-485c9aff-e1cd-490a-a9ee-8d2cfa38a00e req-308187b4-710c-4770-bb90-ef7d4b0fefc5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072622 Jan 27 16:50:15.339995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 153/294] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:15.452632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4bd7f94e-6039-456b-baf1-13790861fd13 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 23793 microversion: 2.20 time: 0.163087 Jan 27 16:50:15.453343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 142/295] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:15 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 23793 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:15.501263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:15.502107 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:15.510359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.510836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.511870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.512331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.604538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-44628c15-6989-4af4-a8cb-a4693c9bc70a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 21343 microversion: 2.1 time: 0.107263 Jan 27 16:50:15.605198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 154/296] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:15 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 21343 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:15.696898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:15.697767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:15.704926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.705447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.706641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:15.707269 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:15.847448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:15.855355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d17c30b2-6fca-45dd-b21e-4cc6aff8e04e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.162924 Jan 27 16:50:15.855950 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 143/297] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:15 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:16.161948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:16.162844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:16.170701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.171149 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.171949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.172381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.322673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:16.330546 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19dae22f-7390-4b84-8ed0-a7b24c0c562b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.172713 Jan 27 16:50:16.331103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 155/298] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:16 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:16.464490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:16.465306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:16.471475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.471953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.472730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.473161 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.571265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b5e7700a-80f9-4eb5-83ce-d544a455c6f5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 24526 microversion: 2.20 time: 0.109691 Jan 27 16:50:16.571949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 144/299] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:16 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 24526 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:16.615914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:16.616826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:16.624042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.624487 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.625287 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.625722 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.719747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-faa7d6a5-6455-41d3-940d-f4527a9c8801 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 22493 microversion: 2.1 time: 0.107251 Jan 27 16:50:16.723491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 156/300] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:16 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 22493 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:16.872997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:16.873839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:16.883601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.884753 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:16.885977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:16.886637 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.029429 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:17.037550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f81493fd-8c7b-44bc-9b38-45e0e6eb96ea tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1317 microversion: 2.1 time: 0.169049 Jan 27 16:50:17.038188 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 145/301] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:16 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:17.349998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:17.350981 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:17.360447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.360895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.361682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.362115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.515865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:17.521328 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-94095ba7-528b-4d15-be36-960bad8fc704 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.175919 Jan 27 16:50:17.522018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 157/302] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:17 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:17.582315 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:17.583498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:17.591893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.592587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.593380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.593803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.730166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:17.731070 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:17.737244 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.737683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:17.738441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:17.738863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:20.446536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2a016522-f780-4bcf-b798-970ca5308347 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 25076 microversion: 2.1 time: 2.719832 Jan 27 16:50:20.447174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 158/303] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:17 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 25076 bytes in 2721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:20.451975 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:20.452668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:20.459375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:20.459846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:20.460626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:20.461050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:20.466157 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fa2e9796-4988-44a0-b425-07d41024d9dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 26551 microversion: 2.20 time: 2.887456 Jan 27 16:50:20.469993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 146/304] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:17 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 26551 bytes in 2889 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:20.472487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:20.473185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:20.479947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:20.480401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:20.481180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:20.481619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:20.667783 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:20.678041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:20.681149 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d5eb0d32-e3fd-4d11-8f24-25d5d92bd399 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1507 microversion: 2.1 time: 0.232497 Jan 27 16:50:20.684400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 159/305] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:20 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:20.687388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b93b4f00-5353-400f-b82b-e6444f4eb149 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.219177 Jan 27 16:50:20.688074 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 147/306] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:20 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:21.458771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:21.459773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:21.466381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.466813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.467603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.468033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.478403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:21.479404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:21.485751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.486267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.487048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.487499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.566709 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-451c44be-0e32-4b38-8fb6-b2204dfc9f7b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 25771 microversion: 2.1 time: 0.112148 Jan 27 16:50:21.567610 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 160/307] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:21 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 25771 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:21.591641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-72091cfe-bc56-4547-9127-a7e8e70aa29b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 27066 microversion: 2.20 time: 0.117405 Jan 27 16:50:21.592280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 148/308] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:21 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 27066 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:21.705551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:21.706245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:21.713705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.714089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.714862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:21.715295 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:21.848887 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:21.856905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-091aa47a-a07a-45a3-8146-520a1fdf8661 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.155319 Jan 27 16:50:21.857759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 161/309] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:21 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:22.004213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6572ae-bcea-4842-9158-ac15a8c9557b"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:22.005339 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:22.012316 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.012758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.013540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.013966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.264456 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7cee0385-b00d-4221-b6c6-6793e5e1a470 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264530 Jan 27 16:50:22.274371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 149/310] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:50:21 2022] POST /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:22.586598 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:22.588889 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:22.599055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.599862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.601892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.602661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.605435 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:22.607001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:22.614027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.614490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.615298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.615736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.711960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7be81cb6-aaf6-4288-8bd2-8af8623381f6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 27512 microversion: 2.20 time: 0.111223 Jan 27 16:50:22.715710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 150/311] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:22 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 27512 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:22.727237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-22be0001-0b89-4737-ad9e-e39f2c0ed20f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 26341 microversion: 2.1 time: 0.151008 Jan 27 16:50:22.728105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 162/312] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:22 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 26341 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:22.874583 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:22.875556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:22.882801 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.883262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:22.884091 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:22.884530 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:23.024947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:23.033241 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4315b31a-71c9-472a-b0ca-de5c2e05e5dd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.162678 Jan 27 16:50:23.033818 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 151/313] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:22 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:23.724598 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:23.725689 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:23.735113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:23.735904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:23.736810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:23.737563 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:23.739318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:23.741144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:23.749460 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:23.750274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:23.751427 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:23.752219 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:23.849624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0b125151-6477-43be-a2a9-744519edfd6b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 27808 microversion: 2.20 time: 0.128998 Jan 27 16:50:23.850614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 163/314] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:23 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 27808 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:23.901198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cae2b7e1-b765-45d0-b3a3-c050b6f93f62 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 27021 microversion: 2.1 time: 0.166264 Jan 27 16:50:23.901845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 152/315] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:23 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 27021 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:24.050348 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:24.051056 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:24.058460 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.058903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.059721 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.060147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.199312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:24.207992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-98d147e1-1f78-4af3-acf9-f69945eb0d95 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.161327 Jan 27 16:50:24.208565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 164/316] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:24 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:24.863372 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:24.864788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:24.872220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.872789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.873744 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.874278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.915053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:24.915992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:24.923220 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.923823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.924787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:24.925322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:24.978964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-76850635-fd4c-4c69-977b-c62e1d241347 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 27989 microversion: 2.20 time: 0.119923 Jan 27 16:50:24.980057 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 153/317] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:24 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 27989 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:25.038414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-82502826-4100-496f-adfb-cd993c4fcb6f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 27410 microversion: 2.1 time: 0.128082 Jan 27 16:50:25.039378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 165/318] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:24 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 27410 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:25.226944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:25.227704 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:25.234510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:25.234954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:25.235769 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:25.236203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:25.372652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:25.380403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-975f8908-be45-4caa-92d6-776fc467b9a1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.158286 Jan 27 16:50:25.380954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 154/319] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:25 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:25.991379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:25.992413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:25.999441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:25.999957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.000827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:26.001292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.050070 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:26.051644 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:26.066378 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:26.066899 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.067834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:26.068270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.115256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e7ccdc50-e9bb-405e-a09b-337485c3b6dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 0.127598 Jan 27 16:50:26.115700 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 166/320] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:25 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:26.173465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b77c7e88-1da3-4d00-a7c4-fe2a03cc1493 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 27607 microversion: 2.1 time: 0.126666 Jan 27 16:50:26.177627 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 155/321] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:26 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 27607 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:26.399960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:26.400690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:26.407425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:26.407895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.408671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:26.409094 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:26.557911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:26.565896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-040865c5-417b-4801-b45e-0525cc0dea80 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.171349 Jan 27 16:50:26.566685 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 167/322] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:26 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:27.126822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:27.127966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:27.135990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.136430 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.137211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.137638 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.185744 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:27.186654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:27.193281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.193732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.194538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.195861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.228388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-930d12da-b30c-4ed6-ad65-3cd93c8dcefe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 0.105437 Jan 27 16:50:27.229861 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 156/323] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:27 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:27.301924 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-48192cd1-f824-4fd3-9411-d6a5527db228 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 27781 microversion: 2.1 time: 0.119694 Jan 27 16:50:27.302598 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 168/324] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:27 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 27781 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:27.583472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:27.584210 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:27.591728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.592232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.593010 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:27.593649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:27.735544 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:27.742816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c6f6dac4-0a29-485b-befc-b9a180809a0e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.163310 Jan 27 16:50:27.743369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 157/325] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:27 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:28.240728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:28.242428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:28.249341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.249791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.250561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.250999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.313335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:28.314356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:28.320716 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.321254 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.322112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.322630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.335030 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-568b3efb-2f7b-4f4d-88bb-5aad167acf54 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 0.098181 Jan 27 16:50:28.336062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 169/326] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:28 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:28.445975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1c0030d1-1350-4429-829b-3e09f909b65b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28007 microversion: 2.1 time: 0.136127 Jan 27 16:50:28.447103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 158/327] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:28 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28007 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:28.760469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:28.761155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:28.767925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.768369 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.769131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:28.769597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:28.899418 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:28.908030 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-24197fab-5b21-4393-81d6-f56431206aa1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.152019 Jan 27 16:50:28.908631 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 170/328] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:28 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:29.347715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:29.348744 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:29.356278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:29.356722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:29.357494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:29.357926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:29.457568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:29.458394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:29.465491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:29.465940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:29.466713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:29.467146 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:32.114426 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-aa8f1d2d-ef43-4df0-ab83-80acfb3d9d37 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28132 microversion: 2.1 time: 2.660163 Jan 27 16:50:32.115510 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 171/329] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:29 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28132 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:32.123837 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:32.124791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:32.126490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0f64d349-13e2-4047-a384-6a83889b7351 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 2.782717 Jan 27 16:50:32.127819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 159/330] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:29 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:32.136778 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:32.137228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:32.138011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:32.138441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:32.273773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:32.280983 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cc7bda1f-41eb-4932-b97e-85a02e500e22 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.163468 Jan 27 16:50:32.281581 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 172/331] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:32 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:32.925756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c6572ae-bcea-4842-9158-ac15a8c9557b"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:32.926878 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:32.935452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:32.935918 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:32.936685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:32.937120 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.014123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Invalid volume: volume 6c6572ae-bcea-4842-9158-ac15a8c9557b is already attached to instances: 60f03e7b-7a84-4810-9b70-efe8c671c055 Jan 27 16:50:33.014710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 400 to user: Invalid volume: volume 6c6572ae-bcea-4842-9158-ac15a8c9557b is already attached to instances: 60f03e7b-7a84-4810-9b70-efe8c671c055 {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:50:33.015522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-62789c81-1db2-47de-86f2-dd5922e23056 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093946 Jan 27 16:50:33.016079 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 160/332] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:50:32 2022] POST /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:50:33.073586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:33.074096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:33.080443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.080895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.081683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.082122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.129000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:33.129936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:33.137320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.137774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.138559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.139001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.162347 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'services' on Instance uuid 60f03e7b-7a84-4810-9b70-efe8c671c055 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:50:33.229854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19bf64c3-080a-48ee-ad29-89f29f2f7e9c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments/6c6572ae-bcea-4842-9158-ac15a8c9557b" status: 202 len: 0 microversion: 2.1 time: 0.159773 Jan 27 16:50:33.230438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 173/333] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:50:33 2022] DELETE /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments/6c6572ae-bcea-4842-9158-ac15a8c9557b => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:33.235515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:33.236593 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:33.242841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.243327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:33.244146 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:33.244584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:36.330303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ec4201c5-f609-4158-b56f-b87d6f6f2574 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28132 microversion: 2.1 time: 3.204548 Jan 27 16:50:36.330830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 161/334] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:33 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28132 bytes in 3206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:36.335908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:36.336893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:36.343623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:36.344074 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:36.344847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:36.345314 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:36.369116 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2fa4ffc2-6339-4f5b-9828-a00435bedff4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 3.136956 Jan 27 16:50:36.370096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 174/335] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:33 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 3139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:36.382250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:36.383397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:36.389418 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6ccade79-f439-464f-a078-f8cde198c3df tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056613 Jan 27 16:50:36.390590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 162/336] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:36 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:36.395271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:36.396050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:36.397349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:36.398558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:36.562537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:36.569833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6ccb415e-864e-4a54-aff6-c6a91ef8d9f2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.198302 Jan 27 16:50:36.570417 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 175/337] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:36 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:37.342653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:37.343685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:37.352523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:37.353126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:37.353984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:37.354489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:37.383092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:37.384136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:37.390385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:37.390852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:37.391650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:37.392083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.028393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4e3cc479-e6c3-4037-a3ea-ccfdce833f4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28132 microversion: 2.1 time: 0.689761 Jan 27 16:50:38.029384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 163/338] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:37 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28132 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:38.033866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:38.034846 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:38.036941 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3c327663-8b26-45b8-b962-91f21d860df3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 0.657934 Jan 27 16:50:38.037583 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 176/339] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:37 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:38.041867 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.042310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.042732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:38.043082 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.043441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:38.043559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.050510 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.050962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.051771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.052214 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.072632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-852b5ea2-4d3b-4ba2-8652-c6f8107950a6 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042417 Jan 27 16:50:38.073202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 164/340] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:50:38 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:50:38.203841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:38.211954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d03c436d-b1d6-43b9-8111-99492dae6458 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.173035 Jan 27 16:50:38.212701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 177/341] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:38 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:38.227266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-18099917", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "e61a4ef3-534d-479d-8867-5085e7d92be1"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:38.278917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] validate_networks() for [('e61a4ef3-534d-479d-8867-5085e7d92be1', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:50:38.659131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:50:38.659719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:50:38.660040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:50:38.660442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:50:38.660848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:50:38.669412 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.669827 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.670698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:38.671236 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:38.688589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:50:38.692338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Getting quotas for user 3cfe4a71879849b581eb8b48b24107fd and project 598ee83f7e1a494c8b94f241ab626b65. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:50:38.703764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:50:38.706200 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:50:38.751627 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f715ca91-095b-481e-8dcb-f4d60230cf20 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527978 Jan 27 16:50:38.752262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 165/342] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:50:38.762186 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c58147d5-8c07-4cd8-b8d6-925e0cea7aba tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:38.762791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c58147d5-8c07-4cd8-b8d6-925e0cea7aba tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:38.825923 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c58147d5-8c07-4cd8-b8d6-925e0cea7aba tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:38.833442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c58147d5-8c07-4cd8-b8d6-925e0cea7aba tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1216 microversion: 2.1 time: 0.074853 Jan 27 16:50:38.833989 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 178/343] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:38 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:39.040262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:39.041437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:39.047474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:39.047956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:39.048740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:39.049108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:39.049235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:39.050375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:39.057169 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:39.057717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:39.058667 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:39.059060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:41.176057 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-84083df5-cd82-45f1-84d3-8b559c40dc87 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28132 microversion: 2.1 time: 2.139187 Jan 27 16:50:41.178872 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 166/344] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:39 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28132 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:41.183087 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:41.183815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:41.190641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:41.191090 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:41.191963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:41.192399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:41.196063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-33592d96-ee09-45e0-877e-b344cb8b5985 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 2.150810 Jan 27 16:50:41.196775 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 179/345] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:39 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 2153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:41.201865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:41.202561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:41.210476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:41.211171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:41.212153 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:41.212581 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:41.300126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:41.314575 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0c3e89db-c49f-4d3f-b5dd-06479a6ffb39 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1220 microversion: 2.1 time: 0.116466 Jan 27 16:50:41.315326 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 180/346] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:41 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:41.363325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:41.371130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-84c5a1ef-bddc-45cd-9e9b-419764d3cebb tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.193286 Jan 27 16:50:41.371717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 167/347] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:41 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:42.189910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:42.190860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:42.197499 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.198079 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.198735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.199327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.207665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:42.209142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:42.216667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.217394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.218344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.219053 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.307109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c7465f4e-bda6-4733-9c9e-aee0f8fbeafd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28132 microversion: 2.1 time: 0.121847 Jan 27 16:50:42.314002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 181/348] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:42 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28132 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:42.332922 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:42.334286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:42.334447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-591b944a-2254-44e2-aeb0-f92694dcf11d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28175 microversion: 2.20 time: 0.130394 Jan 27 16:50:42.335298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 168/349] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:42 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28175 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:42.342974 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.343494 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.349312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.349853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.390401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:42.391116 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:42.402471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.402919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.404602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:42.404602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:42.452433 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:42.461100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9fc2e56c-ef33-4fe1-9a55-ed657d87c2bd tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1274 microversion: 2.1 time: 0.133036 Jan 27 16:50:42.462105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 182/350] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:42 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:42.634167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:42.652105 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-043c1a99-a97a-417b-a145-855bcb6cd11c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.266118 Jan 27 16:50:42.653146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 169/351] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:42 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:43.320807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:43.321959 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:43.328595 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.329062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.329840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.330401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.358151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:43.359663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:43.370520 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.371077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.371928 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.372378 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.446810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3914a57e-41b3-4466-bd48-e1094b7c92bc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28157 microversion: 2.1 time: 0.131716 Jan 27 16:50:43.447601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 183/352] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:43 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28157 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:43.478224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:43.478915 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:43.485937 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.486402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.487472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.488034 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.492792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a3effed5-857a-4e0f-aaa8-bdc0a1d9f307 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28465 microversion: 2.20 time: 0.140086 Jan 27 16:50:43.493438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 170/353] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:43 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28465 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:43.553778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d7f10e8d-cd55-4155-8b90-b180b13e0d4f req-4dbc72fe-0f1a-469c-80b4-5b4df0d58637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9b57a4-9946-4ef9-9ad9-f37538d57fa8", "tag": "903a0057-a715-41da-8342-5ec1b0689573"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:43.555323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:50:43.555323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:50:43.570334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d7f10e8d-cd55-4155-8b90-b180b13e0d4f req-4dbc72fe-0f1a-469c-80b4-5b4df0d58637 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.571109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d7f10e8d-cd55-4155-8b90-b180b13e0d4f req-4dbc72fe-0f1a-469c-80b4-5b4df0d58637 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.585404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d7f10e8d-cd55-4155-8b90-b180b13e0d4f req-4dbc72fe-0f1a-469c-80b4-5b4df0d58637 service nova] Creating event network-changed:903a0057-a715-41da-8342-5ec1b0689573 for instance 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 on hv-cinder-81883 Jan 27 16:50:43.591109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d7f10e8d-cd55-4155-8b90-b180b13e0d4f req-4dbc72fe-0f1a-469c-80b4-5b4df0d58637 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Jan 27 16:50:43.591768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 171/354] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:50:43.652960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:43.660291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-bd1539ca-4c50-468b-b18a-ed1b195d4431 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.186108 Jan 27 16:50:43.660879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 184/355] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:43 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:43.670978 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:43.671714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:43.677943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.678394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.679267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:43.679757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:43.811883 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:43.819851 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b1f0b59f-9f19-499c-bb08-c1fe3e398bfd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1522 microversion: 2.1 time: 0.152676 Jan 27 16:50:43.820421 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 172/356] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:43 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:44.458741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:44.460468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:44.467096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.467548 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.468367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.468810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.505386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:44.506354 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:44.512618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.513233 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.514053 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.514534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.592927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d92f37a7-c9d0-4341-a474-283ecbd1324f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28420 microversion: 2.1 time: 0.137912 Jan 27 16:50:44.594214 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 185/357] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:44 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28420 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:44.630100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-49730fff-f3b9-4a90-b2ee-68c763dc1b8f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28465 microversion: 2.20 time: 0.128767 Jan 27 16:50:44.630842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 173/358] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:44 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28465 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:44.678345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:44.679199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:44.687770 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.688219 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.689011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.689447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.827919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:44.837461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0cce976d-bed1-4221-9ae3-7dbf66fc6d1d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.163315 Jan 27 16:50:44.838037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 186/359] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:44 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:44.838160 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:44.838814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:44.845962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.846452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.847360 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:44.847822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:44.979920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:44.987585 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-53c213fc-be4d-436e-bc8e-21de8bb8527a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1502 microversion: 2.1 time: 0.155118 Jan 27 16:50:44.988156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 174/360] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:44 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:45.003951 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:45.004562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:45.010370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.010815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.011604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.012043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.140917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:45.148920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f0979f1f-b191-4cd7-bfaf-4553b5ed120c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1515 microversion: 2.1 time: 0.149232 Jan 27 16:50:45.149474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 187/361] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:44 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:45.604537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:45.605367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:45.611800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.612398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.613194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.613648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.642878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:45.643826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:45.651671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.652115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.652881 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.653307 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.755933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4113c0e1-716d-43c7-8662-9c7724711978 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.117040 Jan 27 16:50:45.757166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 188/362] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:45 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:45.776989 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9de1112b-f4a4-4f7f-b570-8fa51403ef66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28420 microversion: 2.1 time: 0.176081 Jan 27 16:50:45.777562 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 175/363] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:45 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28420 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:45.855505 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:45.856144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:45.863001 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.863453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.864245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:45.864706 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:45.998548 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:46.006444 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ab235389-f864-451e-9667-258e3c533d7c tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.154991 Jan 27 16:50:46.007193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 189/364] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:45 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:46.502910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:46.504676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:46.512231 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.512732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.513564 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.513999 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.537855 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lazy-loading 'flavor' on Instance uuid 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:50:46.612445 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-953a28d7-fcb7-4d70-ae6b-8c181a1edd7a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action" status: 200 len: 32 microversion: 2.1 time: 0.113651 Jan 27 16:50:46.613407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 176/365] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:46 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action => generated 32 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:50:46.623195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:46.623819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:46.630509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.630953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.632686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.633182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.768943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:46.770010 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:46.780256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.780668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:46.781148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.781480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.781909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.794636 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ca8bd783-1f62-4730-b533-e820af575465 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.174450 Jan 27 16:50:46.795435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 190/366] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:46 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:46.800472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:46.801771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:46.811164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.812588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.813621 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:46.814228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:46.874438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7b815430-cadb-4d9a-8381-94f16c958ea8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.109331 Jan 27 16:50:46.875612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 177/367] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:46 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:46.918236 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-329b416b-0906-49d6-987a-5c82f3a683b8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.121189 Jan 27 16:50:46.918879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 191/368] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:46 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:47.031829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:47.032610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:47.040491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.041085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.041965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.042476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.189908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:47.198009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-22698ad4-618b-4325-b7fd-b81e9182b19d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.170716 Jan 27 16:50:47.198660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 178/369] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:47 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:47.812823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:47.813816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:47.821071 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.821791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.822787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.823480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.886750 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:47.887705 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:47.909575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.919471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.920505 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:47.920966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:47.997186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a895489a-6c12-46dd-a6a5-f593dc90be28 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.114407 Jan 27 16:50:47.999682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 179/370] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:47 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:48.005534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:48.006880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:48.014566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:48.015203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:48.016172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:48.016759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:48.019761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:48.034202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-35ca7495-0d94-4e9d-a619-5b8a112fa5f1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.225273 Jan 27 16:50:48.035792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 192/371] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:47 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:48.125888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-96be1e01-e75d-420b-93e3-fa4612178c47 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.124417 Jan 27 16:50:48.126898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 180/372] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:47 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:48.215131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:48.216003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:48.227279 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:48.228029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:48.228896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:48.229529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:48.407486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:48.419711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-491bfe52-ca4d-41e1-a39d-ef85f818d429 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.207728 Jan 27 16:50:48.427606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 193/373] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:48 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:49.010019 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:49.011670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:49.021533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.022986 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.024267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.024946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.053549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:49.054175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:49.063849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.064241 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.065035 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.065468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.108534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5a387948-973e-4ffc-944d-508b47384fc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.102914 Jan 27 16:50:49.109706 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 181/374] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:49 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:49.138543 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:49.139541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:49.150489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.151403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.152501 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.153200 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.237136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-57bb55ce-612d-4906-93ed-0d418fc10fdb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.101813 Jan 27 16:50:49.239965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 182/375] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:49 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:49.267391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:49.275959 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-39ae8516-eb97-4a3a-a1cd-82baf819dc2c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.227546 Jan 27 16:50:49.276500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 194/376] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:49 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:49.436624 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:49.437334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:49.444964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.445640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.446719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.447343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.579243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-2658cfec-f862-48c2-9be8-a8c5b8a74381 req-4405af1b-dd12-45d9-88be-3d620bbcf22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9b57a4-9946-4ef9-9ad9-f37538d57fa8", "name": "network-vif-plugged", "status": "completed", "tag": "903a0057-a715-41da-8342-5ec1b0689573"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:49.581464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:50:49.581464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:50:49.601516 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2658cfec-f862-48c2-9be8-a8c5b8a74381 req-4405af1b-dd12-45d9-88be-3d620bbcf22f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:49.601963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2658cfec-f862-48c2-9be8-a8c5b8a74381 req-4405af1b-dd12-45d9-88be-3d620bbcf22f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:49.613288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:49.622805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b127f326-ddb1-4400-a4d4-ceecdd8af04f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.190192 Jan 27 16:50:49.632195 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 183/377] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:49 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:49.640748 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-2658cfec-f862-48c2-9be8-a8c5b8a74381 req-4405af1b-dd12-45d9-88be-3d620bbcf22f service nova] Creating event network-vif-plugged:903a0057-a715-41da-8342-5ec1b0689573 for instance 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 on hv-cinder-81883 Jan 27 16:50:49.653228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-2658cfec-f862-48c2-9be8-a8c5b8a74381 req-4405af1b-dd12-45d9-88be-3d620bbcf22f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084888 Jan 27 16:50:49.656574 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 195/378] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:50:50.121734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:50.122888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:50.134567 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.139386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.140387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.140903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.250792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:50.252401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:50.259489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.260155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.261190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.261635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.338296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ad8e1451-e226-4c33-9dd5-7afa7ac0d813 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.220612 Jan 27 16:50:50.339197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 184/379] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:50 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:50.342572 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1270bfc5-1192-4d6c-84f6-0d248a94cbdf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.096647 Jan 27 16:50:50.343271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 196/380] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:50 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:50.348006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:50.348712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:50.355558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.356042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.356831 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.357267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.555919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:50.565785 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-580c570a-273b-43a9-864b-a6050c24f0b6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.225132 Jan 27 16:50:50.566940 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 185/381] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:50 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:50.640820 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:50.641756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:50.652112 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.653085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.654201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:50.655359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:50.858597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:50.867425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3946cab2-d51d-405c-ae09-83000ed194ab tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1316 microversion: 2.1 time: 0.231632 Jan 27 16:50:50.877118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 197/382] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:50 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:51.350792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:51.351762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:51.357125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:51.358677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:51.363446 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.363937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.364736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.365167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.367980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.368676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.369735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.370501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.499833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25e0f645-c76e-415c-ab2a-154f49a118d6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.147932 Jan 27 16:50:51.505860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 198/383] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:51 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:51.561517 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4cf86439-0a3f-403d-b3e1-3e72eff8a5ea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28632 microversion: 2.20 time: 0.214616 Jan 27 16:50:51.562730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 186/384] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:51 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28632 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:51.585878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:51.586677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:51.605637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.606381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.607763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.609056 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.860826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:51.869394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d389a197-a5a5-4444-8cc7-317f06100899 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.289422 Jan 27 16:50:51.869971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 199/385] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:51 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:51.885714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:51.887473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:51.900041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.902526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:51.903419 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:51.903887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.058848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:52.066672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bb68a434-c121-451c-9a69-239174fc632a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1507 microversion: 2.1 time: 0.186123 Jan 27 16:50:52.067327 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 187/386] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:51 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:52.514082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:52.515103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:52.530447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.531205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.532330 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.532876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.573639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:52.574680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:52.581968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.582543 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.583503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.584636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.623453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5e1b9572-0222-4ccf-8759-e73671655405 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 28588 microversion: 2.1 time: 0.112514 Jan 27 16:50:52.627748 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 200/387] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:52 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 28588 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:52.741496 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-be5d5e93-fc7c-4d22-b329-1a4fd296ab34 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 28817 microversion: 2.20 time: 0.170197 Jan 27 16:50:52.742915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 188/388] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:52 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 28817 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:52.900593 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:52.901349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:52.929068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.932705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:52.941008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:52.941842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.229647 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:53.238386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d9d945ec-2baf-4b11-835c-7a0f2d30ecf1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.353650 Jan 27 16:50:53.239894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 201/389] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:52 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:53.538449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a9db5cb-5596-4c86-8c38-065b676568bd"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:53.539952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:53.548333 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.550169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.553319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.554274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.637443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:53.639106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:53.653067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.653867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.655015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.655690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.775507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c65c74d9-b01c-4b6b-adaa-df15f74cadc9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 29526 microversion: 2.1 time: 0.142397 Jan 27 16:50:53.777066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 202/390] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:53 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 29526 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:53.781806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:53.783090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:53.792100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.792856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.793852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:53.794727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:53.914646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-29211abd-6826-4226-88e5-c53679304d0d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 30494 microversion: 2.20 time: 0.136977 Jan 27 16:50:53.919009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 203/391] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:53 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 30494 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:53.996639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-efbfead3-7db2-42e6-83b8-807f02bd33d2 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "POST /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.464147 Jan 27 16:50:53.998195 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 189/392] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:50:53 2022] POST /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:50:54.275669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:54.276761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:54.291484 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.292297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:54.293349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.293982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:54.555074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:54.564728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-32bb565a-b172-494a-9431-f5c3844841b3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.311271 Jan 27 16:50:54.566300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 204/393] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:54 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:54.788009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:54.789184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:54.797777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.798667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:54.799770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.800443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:54.924745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9c71048c-de56-4c2b-a93f-8d169436a2f1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 30689 microversion: 2.1 time: 0.141331 Jan 27 16:50:54.926058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 190/394] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:54 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 30689 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:54.928173 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:54.930756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:54.955900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.956349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:54.957152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:54.962830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:55.112541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-022a9f52-8733-4ec8-8bc2-05d4a1290d72 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 31441 microversion: 2.20 time: 0.189250 Jan 27 16:50:55.113630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 205/395] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:54 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 31441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:55.577740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1147441507", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "d5d058f3-de8c-4c0f-bf66-49f826de473b"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:55.594646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:55.594646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:55.603202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:55.603716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:55.612039 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:55.612494 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:55.688282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] validate_networks() for [('d5d058f3-de8c-4c0f-bf66-49f826de473b', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:50:55.921716 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:55.948436 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c872a139-5f87-40e3-8003-e8e7de4ad867 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.368599 Jan 27 16:50:55.950041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 206/396] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:55 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:55.959766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:55.963280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:55.972776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:55.973939 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:55.975795 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:55.976739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.089714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a4c412e0-79b4-451f-b251-4e6af1da9856 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 32345 microversion: 2.1 time: 0.138233 Jan 27 16:50:56.090351 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 207/397] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:55 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 32345 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:56.132098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:56.133407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:56.145331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.146170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.147665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.149409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.237990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:50:56.238745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:50:56.239695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:50:56.241341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:50:56.242715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:50:56.253903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.254733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.256169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.257132 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.259935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-afa806c3-7ea4-4b9f-858a-fc159c09b259 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 32275 microversion: 2.20 time: 0.138942 Jan 27 16:50:56.264024 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 208/398] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:56 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 32275 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:56.281708 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Getting quotas for project a92d0592f8f14b89a36b145413b2fbe1. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:50:56.286136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Getting quotas for user 8c67a45bdb0d4dcfbd59e88c6eb6f7f5 and project a92d0592f8f14b89a36b145413b2fbe1. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:50:56.308999 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:50:56.312652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:50:56.363907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e9bc8beb-32f6-4760-8c3f-fe9eaeaef079 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790243 Jan 27 16:50:56.364654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 191/399] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:50:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:50:56.375233 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d6f12314-eda3-4603-9380-0d750a3f51a3 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:56.375980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d6f12314-eda3-4603-9380-0d750a3f51a3 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:56.459484 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d6f12314-eda3-4603-9380-0d750a3f51a3 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:56.468087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d6f12314-eda3-4603-9380-0d750a3f51a3 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1214 microversion: 2.1 time: 0.096735 Jan 27 16:50:56.478029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 209/400] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:56 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:56.966107 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:56.966721 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:56.983349 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.984120 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:56.985072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:56.985512 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.101719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:57.102652 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:57.110913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.111926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.113229 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.114095 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.212651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a23886ad-f59e-4a70-b205-14d77ec6706b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 33197 microversion: 2.1 time: 0.114854 Jan 27 16:50:57.217359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 210/401] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:57 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 33197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:57.276358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:57.277368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:57.292299 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.293672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.299610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:57.305929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.309242 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.312178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9571f4aa-71e5-4114-a698-dce99a9565bf tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.350244 Jan 27 16:50:57.323629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 192/402] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:56 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:57.419027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e51b5f0d-c8b3-46a6-9a47-13fb274ddb64 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 32977 microversion: 2.20 time: 0.147982 Jan 27 16:50:57.423656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 211/403] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:57 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 32977 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:57.488222 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:57.489063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:57.497226 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.497972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.498959 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:57.499715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:57.597326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:57.612674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9c247e76-7c7d-464a-938c-c66d130f255a tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1266 microversion: 2.1 time: 0.130817 Jan 27 16:50:57.615907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 193/404] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:57 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:58.226503 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:58.228159 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:58.234857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.235533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.236482 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.237053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.329311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:58.330204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:58.337122 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.337824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.338794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.339415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.358536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f8b5db59-f8b3-4dbb-9497-9f1ac0bd158d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 33717 microversion: 2.1 time: 0.136041 Jan 27 16:50:58.359192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 212/405] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:58 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 33717 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:50:58.432603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:58.434284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:58.451225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.454973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.456038 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.456634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.562847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cbd6b753-492a-4051-83b2-7fa02431c37d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 33557 microversion: 2.20 time: 0.134755 Jan 27 16:50:58.564223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 213/406] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:58 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 33557 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:50:58.630900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:58.631671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:58.655293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.656376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.671025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:58.672439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:58.734749 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:58.746775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e4a13360-c79d-4067-b5f9-5f65ccb72e90 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.420941 Jan 27 16:50:58.748178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 194/407] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:58 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:50:58.933691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:50:58.942216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-60f69ae9-f4d1-4177-a2d1-2342ffa8eea1 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1272 microversion: 2.1 time: 0.315426 Jan 27 16:50:58.954936 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 214/408] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:58 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:50:59.370644 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:59.372654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:59.383434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.392609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.408021 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.408873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.531474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-56931b2c-3dde-4a1e-86bd-f979a7a2d7c0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 34263 microversion: 2.1 time: 0.164108 Jan 27 16:50:59.533188 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 195/409] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:50:59 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 34263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:50:59.575336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:50:59.578197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:59.591358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.598123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.600052 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.600811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.738854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-10db03b6-2566-4221-87f1-3fe8c6f056d4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 34505 microversion: 2.20 time: 0.166596 Jan 27 16:50:59.741032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 215/410] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:50:59 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 34505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:50:59.764829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:59.765538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:59.779094 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.779831 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.780460 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.780889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.962931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:50:59.963994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:50:59.985794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.989910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:50:59.994950 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:50:59.995412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:00.009408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:00.016815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-da359be8-e0e3-46d5-bb4a-166ab90eae30 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.256131 Jan 27 16:51:00.017385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 196/411] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:59 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:00.194711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:00.205442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9e075eb4-a9ed-4767-9be6-2a4c4d2d1d19 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.246689 Jan 27 16:51:00.216139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 216/412] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:50:59 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:00.568043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:00.574545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:00.593557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:00.600490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:00.604974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:00.605434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:00.731099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f67c7863-e086-45a4-b9ec-3d9335e902e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 34867 microversion: 2.1 time: 0.190311 Jan 27 16:51:00.731783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 197/413] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:00 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 34867 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:00.752757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:00.756135 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:00.769004 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:00.769818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:00.778262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:00.779547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:00.925564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-340207d2-9524-479e-a71b-cdcb115ea7bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 35210 microversion: 2.20 time: 0.175670 Jan 27 16:51:00.930571 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 217/414] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:00 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 35210 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:00.978518 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-83c7967b-2650-4358-a3d3-0a1efe0b3273 req-9e49700d-92db-4a44-a006-491dc7b1e21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1", "tag": "405aa040-774d-4e6f-a24e-9f71de3bfaaa"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:00.986444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:00.986444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:01.000786 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-83c7967b-2650-4358-a3d3-0a1efe0b3273 req-9e49700d-92db-4a44-a006-491dc7b1e21b service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.001400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-83c7967b-2650-4358-a3d3-0a1efe0b3273 req-9e49700d-92db-4a44-a006-491dc7b1e21b service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.024022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-83c7967b-2650-4358-a3d3-0a1efe0b3273 req-9e49700d-92db-4a44-a006-491dc7b1e21b service nova] Creating event network-changed:405aa040-774d-4e6f-a24e-9f71de3bfaaa for instance 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 on hv-cinder-81883 Jan 27 16:51:01.032614 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-83c7967b-2650-4358-a3d3-0a1efe0b3273 req-9e49700d-92db-4a44-a006-491dc7b1e21b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061198 Jan 27 16:51:01.033681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 198/415] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:01.044505 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:01.045699 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:01.068664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.071595 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.073541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.075687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.224145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:01.226017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:01.243144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.244095 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.245135 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.245919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.479895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:01.508238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-827f0d53-6f24-422d-87d5-0aca39350a44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.472715 Jan 27 16:51:01.520485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 218/416] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:01 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:01.660665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:01.680711 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dc5690db-9c94-4fe5-923b-ce62672fabc0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.459765 Jan 27 16:51:01.681609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 199/417] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:01 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:01.744538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:01.746068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:01.765136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.768651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.769703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.775413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.942999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5239aece-f710-46a9-8b52-f2de83cde7b2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 35590 microversion: 2.1 time: 0.204129 Jan 27 16:51:01.945521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:01.946096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 219/418] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:01 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 35590 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:01.947373 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:01.959435 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.960503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:01.961572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:01.964804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.111490 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:02.112438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:02.121601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-83f4c6f0-d933-4ef6-b5a6-553bf60a9d6e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 35999 microversion: 2.20 time: 0.187247 Jan 27 16:51:02.122511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.126177 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 200/419] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:01 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 35999 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:51:02.128394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.129249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.129687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.280250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'services' on Instance uuid 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:02.420327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3babf63a-3e5f-4de3-9a07-87bb7997fff0 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments/9a9db5cb-5596-4c86-8c38-065b676568bd" status: 202 len: 0 microversion: 2.1 time: 0.312535 Jan 27 16:51:02.421564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 220/420] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:51:02 2022] DELETE /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments/9a9db5cb-5596-4c86-8c38-065b676568bd => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:51:02.432037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:02.434541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:02.452782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.454569 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.455807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.457335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.536369 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:02.537995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:02.553345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.554500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.559798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.560763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.575266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-754c51a7-62b5-4655-8248-407d2e28737d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148943 Jan 27 16:51:02.587444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 201/421] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:51:02 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:02.698556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:02.701541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:02.741814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.750165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.750999 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.751455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.825205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:02.841349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5a7b9aae-a98c-4a22-a09c-f323992c42f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.317544 Jan 27 16:51:02.846536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 221/422] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:02 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:02.954638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:02.956137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:02.969491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.972016 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.976523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:02.976988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:02.978455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:02.990190 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2dfc2557-3373-48f3-93a0-de41abe82d29 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.295211 Jan 27 16:51:02.991173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 202/423] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:02 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:03.133393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:03.135680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:03.146992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6fae9c36-bb82-4ec8-9868-9fc4b0896763 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 36475 microversion: 2.1 time: 0.195103 Jan 27 16:51:03.148168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 222/424] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:02 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 36475 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:51:03.148560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.149355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:03.150473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.151125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:03.300481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f0fac78a-298b-4a13-bef4-28a009b2aad1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 36699 microversion: 2.20 time: 0.170816 Jan 27 16:51:03.301143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 203/425] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:03 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 36699 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:03.596953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:03.598467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:03.618953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.621866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:03.623235 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.624519 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:03.668155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9a92ec36-2e1f-4880-9e53-d5d425d59f8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079107 Jan 27 16:51:03.671719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 223/426] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:51:03 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:51:03.860146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:03.860951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:03.876119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.876857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:03.877799 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:03.878458 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.094572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:04.103510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7a465b25-dd5d-4639-ac3b-7d1d267c76a7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.248038 Jan 27 16:51:04.105339 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 204/427] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:03 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:04.110926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:04.111667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:04.118335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.119212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.120237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.120867 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.122670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Action: 'create', calling method: .version_select at 0x7f0cf0603dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1061823013"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:04.142844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:51:04.149438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for user d1189e6ca83149dc95cc1a54c3c31421 and project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:51:04.292229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:04.300012 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6006fd00-d41b-49e3-a3e1-67595b1cdb79 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.192848 Jan 27 16:51:04.300640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 205/428] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:04 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:04.307763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:04.308995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:04.320039 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.320791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.321781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.323027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.403480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:51:04.407690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for user d1189e6ca83149dc95cc1a54c3c31421 and project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:51:04.433126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e07737b5-803d-4508-b261-ce42ea1a9890 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.569858 Jan 27 16:51:04.440208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 224/429] 10.222.0.48 () {60 vars in 1157 bytes} [Thu Jan 27 16:51:03 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:04.445647 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:04.446764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bcf2c68d-4c96-44b9-b5c6-dfd3000261e6 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 37187 microversion: 2.1 time: 0.117442 Jan 27 16:51:04.447234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:04.448507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 206/430] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:04 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 37187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:04.454397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.455170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.456001 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.456609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.554381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ec0327d8-40a3-403b-98da-f92e782ab8c7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 37517 microversion: 2.20 time: 0.112028 Jan 27 16:51:04.555022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 225/431] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:04 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 37517 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:04.926412 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:04.927845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:04.936687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.937664 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.939239 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:04.940013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:04.986950 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:05.105218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e05fa112-81c9-4eed-bbd5-57d97e8de55f tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 204 len: 0 microversion: 2.1 time: 0.183074 Jan 27 16:51:05.110763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 207/432] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:04 2022] DELETE /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:05.116217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:05.116928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:05.124394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:05.125397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:05.132562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.133073 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.133794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.134232 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.134562 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.135763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.136807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.137476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.378035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:05.400002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-20216ba1-c9ff-4465-816b-2574d6420ddc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.279228 Jan 27 16:51:05.400692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 208/433] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:05 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:05.409030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:05.410430 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:05.429189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:05.441594 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1ccde2e0-83b5-4683-b131-e76f0cb7b4d4 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1513 microversion: 2.1 time: 0.329747 Jan 27 16:51:05.444669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 226/434] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:05 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:05.451660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.452526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.453623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.454206 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.468710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:05.469867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:05.484500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.485074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.485965 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.486507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.602708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-dabc6e9c-3d9c-4091-a06e-a2e040f539e1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 38041 microversion: 2.1 time: 0.142828 Jan 27 16:51:05.603522 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 227/435] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:05 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 38041 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:05.620295 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:05.621717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:05.633594 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.634302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.635255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:05.644244 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:05.663699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:05.671688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-09268d47-beef-4448-9652-fbab1de49a71 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.268685 Jan 27 16:51:05.672393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 209/436] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:05 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:05.763219 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8428485e-7593-427e-9757-f95c4c811c47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 38136 microversion: 2.20 time: 0.158181 Jan 27 16:51:05.764387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 228/437] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:05 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 38136 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:06.419004 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:06.419886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:06.426400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.426941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.427958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.429352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.473909 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:06.474743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:06.482718 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.482718 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.483313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.483785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.650104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:06.664597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a06863b6-4fed-4bbb-ac3e-07e1bfa14449 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1501 microversion: 2.1 time: 0.250055 Jan 27 16:51:06.665179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 210/438] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:06 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:06.670540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:06.671728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:06.682794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.684678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.686655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.687289 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.693111 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:06.702101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-90b2331f-6b5a-46c0-a8da-1bdaf3030c2d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1513 microversion: 2.1 time: 0.240152 Jan 27 16:51:06.703714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 229/439] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:06 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:06.709110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-731646593", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "3ff7763e-e8af-430b-afaa-86998ea27f64"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:06.772281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] validate_networks() for [('3ff7763e-e8af-430b-afaa-86998ea27f64', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:51:06.823035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1504c363-3588-4681-a423-883ec527c7c7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 38096 microversion: 2.1 time: 0.156389 Jan 27 16:51:06.824130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 211/440] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:06 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 38096 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:06.834111 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68727996-f83d-40fa-a754-318b90a519a3"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:06.835781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:06.843380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.849909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.851811 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.852516 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.891465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] HTTP exception thrown: Cannot 'attach_volume' instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 while it is in vm_state rescued Jan 27 16:51:06.892526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Returning 409 to user: Cannot 'attach_volume' instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 while it is in vm_state rescued {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:06.893487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f482f251-8fc5-404d-8f41-3c24dde652d1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063937 Jan 27 16:51:06.894359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 212/441] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:51:06 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 27 16:51:06.899115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:06.899968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:06.906137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.906727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:06.907681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:06.908223 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.208127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:07.217492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4a648a30-cedb-4567-ab2c-3de28b3db6f8 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.322183 Jan 27 16:51:07.218794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 213/442] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:06 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:07.224699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:07.226191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.232457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.233135 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.233985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.234599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.265994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:51:07.266437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:51:07.266914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:51:07.267535 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:51:07.267982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:51:07.277839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.278286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.279098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.279536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.297314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Getting quotas for project 5f4ae6dda115477db147059df89ad002. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:51:07.302344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Getting quotas for user 7f0c0ea1e431437880ed43ef1c9cb1bb and project 5f4ae6dda115477db147059df89ad002. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:51:07.314779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:51:07.317125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:51:07.346778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4d07950d-dcc0-4d9a-8e65-30601963736d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 38177 microversion: 2.20 time: 0.126556 Jan 27 16:51:07.347513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 214/443] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:07 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 38177 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:07.354323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:07.355042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.362269 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.362715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.363500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.363958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.371966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4fd15983-a867-49fe-89e8-2fe7135d7627 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666919 Jan 27 16:51:07.377462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 230/444] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:51:07.388723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19e6329c-0822-4496-b178-66a49e8ed86a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:07.389349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19e6329c-0822-4496-b178-66a49e8ed86a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.469475 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-19e6329c-0822-4496-b178-66a49e8ed86a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:07.479438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19e6329c-0822-4496-b178-66a49e8ed86a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1218 microversion: 2.1 time: 0.100328 Jan 27 16:51:07.491606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3bc0a987-46ea-4132-84cc-ab039cdc4137 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action" status: 202 len: 0 microversion: 2.1 time: 0.133056 Jan 27 16:51:07.492340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 231/445] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:07 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:07.492441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 215/446] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:07 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:07.497914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:07.498385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.511390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.511866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.512659 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.513088 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.675725 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:07.689539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6bdf834c-3aa9-4d25-b02c-987cf739d264 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1509 microversion: 2.1 time: 0.195525 Jan 27 16:51:07.690440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 232/447] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:07 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:07.721038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:07.721907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.730159 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.732273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.733422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.734131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.835787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:07.836743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:07.843177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.843676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.846920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:07.847613 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:07.905797 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:07.917792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fcef5af2-92f9-488f-ad70-3dfa0304b664 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1513 microversion: 2.1 time: 0.201878 Jan 27 16:51:07.918657 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 216/448] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:07 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:07.963682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-23e39b04-ea6d-4108-a89b-c40989e155ac tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 38102 microversion: 2.1 time: 0.131594 Jan 27 16:51:07.964428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 233/449] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:07 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 38102 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:51:08.234222 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:08.234846 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.242527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.243134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.244514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.245320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.372346 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:08.374332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.384300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.385443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.386710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.387354 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.407592 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:08.415714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-961bc466-fb38-49f6-a57c-4f953b8b5851 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.185186 Jan 27 16:51:08.416605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 217/450] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:08 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:08.506948 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:08.508255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.511262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d9e1e859-45f9-497e-b0d0-fe761885de48 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 200 len: 38305 microversion: 2.20 time: 0.143864 Jan 27 16:51:08.517058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 234/451] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:08 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 38305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:08.521295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.522007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.522979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.523410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.528712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:08.535822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.549360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.549801 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.551382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.551511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.587934 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-521e8c34-d48a-41ae-9b70-a8df2d993410 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/ips" status: 200 len: 151 microversion: 2.20 time: 0.065099 Jan 27 16:51:08.588918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 235/452] 10.222.0.48 () {60 vars in 1288 bytes} [Thu Jan 27 16:51:08 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:51:08.593920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-1787ac03-bc80-44b7-9365-6e53633fa01d req-a15e66cc-fbca-474a-8227-6e4838df3a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9b57a4-9946-4ef9-9ad9-f37538d57fa8", "name": "network-vif-deleted", "tag": "903a0057-a715-41da-8342-5ec1b0689573"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:08.607015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:08.607015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:08.610059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:08.618718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d5921fcd-826d-46fa-8597-8f74097275e2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1270 microversion: 2.1 time: 0.115908 Jan 27 16:51:08.627483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-1787ac03-bc80-44b7-9365-6e53633fa01d req-a15e66cc-fbca-474a-8227-6e4838df3a23 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.628207 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-1787ac03-bc80-44b7-9365-6e53633fa01d req-a15e66cc-fbca-474a-8227-6e4838df3a23 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.628743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 218/453] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:08 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:08.650874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-1787ac03-bc80-44b7-9365-6e53633fa01d req-a15e66cc-fbca-474a-8227-6e4838df3a23 service nova] Creating event network-vif-deleted:903a0057-a715-41da-8342-5ec1b0689573 for instance 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 on hv-cinder-81883 Jan 27 16:51:08.657510 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-1787ac03-bc80-44b7-9365-6e53633fa01d req-a15e66cc-fbca-474a-8227-6e4838df3a23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067072 Jan 27 16:51:08.658366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 236/454] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:08.707897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:08.708725 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.716590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.717347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.718386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.719077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.945135 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:08.945856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:08.957622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.959263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:08.960941 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:08.961557 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.010146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:09.019083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fbd854a2-bac7-4786-9645-a96e2ca5f1db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1509 microversion: 2.1 time: 0.315592 Jan 27 16:51:09.022221 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 219/455] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:08 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:09.035730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:09.036800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:09.051318 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.052650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.053289 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'fault' on Instance uuid 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:09.056281 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.056873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.057873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.058562 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.154776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:09.168920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-020658d2-0de4-4b81-812d-466843c113ec tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 200 len: 1306 microversion: 2.1 time: 0.234677 Jan 27 16:51:09.182003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 237/456] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:08 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 1306 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:09.195103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2217e1a0-41c6-46fa-9357-133668f7596d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 200 len: 38226 microversion: 2.1 time: 0.170092 Jan 27 16:51:09.195917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 220/457] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:09 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 38226 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:51:09.208021 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:09.209127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:09.215374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.215848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.217412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.217855 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.265782 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3575b42c-63bb-455b-a1e9-a9dbb3c73563 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/ips" status: 200 len: 144 microversion: 2.1 time: 0.061504 Jan 27 16:51:09.266943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 238/458] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:51:09 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/ips => generated 144 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:09.436578 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:09.441958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:09.455310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.456227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.457183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.457817 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.630536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:09.637285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:09.638676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:09.646276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.647285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.647398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1a63122c-051d-4d9c-a75e-95eaa2d4e7cd tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.217260 Jan 27 16:51:09.648167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 221/459] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:09 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:09.649120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.649778 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.662992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d94b3328-e318-48eb-8580-3b663f093539 req-7fee3361-3f77-47b0-b361-a9033e198fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1", "name": "network-vif-plugged", "status": "completed", "tag": "405aa040-774d-4e6f-a24e-9f71de3bfaaa"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:09.665429 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:09.665429 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:09.675533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d94b3328-e318-48eb-8580-3b663f093539 req-7fee3361-3f77-47b0-b361-a9033e198fdb service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:09.676202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d94b3328-e318-48eb-8580-3b663f093539 req-7fee3361-3f77-47b0-b361-a9033e198fdb service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:09.692224 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d94b3328-e318-48eb-8580-3b663f093539 req-7fee3361-3f77-47b0-b361-a9033e198fdb service nova] Creating event network-vif-plugged:405aa040-774d-4e6f-a24e-9f71de3bfaaa for instance 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 on hv-cinder-81883 Jan 27 16:51:09.698298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d94b3328-e318-48eb-8580-3b663f093539 req-7fee3361-3f77-47b0-b361-a9033e198fdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043732 Jan 27 16:51:09.699147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 222/460] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:09.829200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:09.838642 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a4f644ae-9c6f-4b8e-95c6-933ecc503d4d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.205535 Jan 27 16:51:09.839227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 239/461] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:09 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:10.042050 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:10.042775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:10.048799 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.049242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.050009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.050436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.188215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:10.189307 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:10.194574 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:10.216324 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5a0744e2-6114-4506-9565-31fe7192b8c4 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1509 microversion: 2.1 time: 0.178606 Jan 27 16:51:10.216982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 223/462] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:10 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:10.217516 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.218202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.219131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.219891 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.237035 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Instance 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 could not be found. Jan 27 16:51:10.237624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 404 to user: Instance 9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:10.238450 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-04455849-1b72-4b77-95bd-7ac552872679 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8" status: 404 len: 111 microversion: 2.1 time: 0.054527 Jan 27 16:51:10.238998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 240/463] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:10 2022] GET /compute/v2.1/servers/9f9b57a4-9946-4ef9-9ad9-f37538d57fa8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:51:10.666364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:10.666904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:10.672671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-ad42a280-0368-4937-8c21-101956581019 req-d7b678e7-3951-40f8-ab72-f99bc9541ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a6eecd-4759-477d-8484-e510a7638b40", "tag": "404e12cf-c62c-4c23-b50c-848e2b404dec"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:10.674345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:10.674345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:10.677138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.677615 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.682012 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.682464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.682628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-ad42a280-0368-4937-8c21-101956581019 req-d7b678e7-3951-40f8-ab72-f99bc9541ad3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.683152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-ad42a280-0368-4937-8c21-101956581019 req-d7b678e7-3951-40f8-ab72-f99bc9541ad3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.697658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-ad42a280-0368-4937-8c21-101956581019 req-d7b678e7-3951-40f8-ab72-f99bc9541ad3 service nova] Creating event network-changed:404e12cf-c62c-4c23-b50c-848e2b404dec for instance 58a6eecd-4759-477d-8484-e510a7638b40 on hv-cinder-81883 Jan 27 16:51:10.703464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-ad42a280-0368-4937-8c21-101956581019 req-d7b678e7-3951-40f8-ab72-f99bc9541ad3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034451 Jan 27 16:51:10.705134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 241/464] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:51:10.828437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:10.836936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2c3b942c-adb4-465b-9ece-e2b3642d5d15 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.176485 Jan 27 16:51:10.840737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 224/465] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:10 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:10.859152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:10.859744 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:10.866656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.867104 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:10.867895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:10.868327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.030540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.048530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2eecd50b-82e3-424e-964e-0ab99803114b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.195900 Jan 27 16:51:11.049603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 242/466] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:10 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:11.184200 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:11.184730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.190703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.191145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.191947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.192404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.216712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lazy-loading 'flavor' on Instance uuid f7ddbd2c-1d14-4efe-9228-3feaa97ef620 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:11.233791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:11.234564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.243712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.244356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.245160 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.245603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.396533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.404870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b3953496-709b-48dc-8d37-064073f2ff6d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1509 microversion: 2.1 time: 0.174672 Jan 27 16:51:11.405558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 243/467] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:11 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:11.410067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:11.410634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.416755 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.417283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.418278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.418792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.446298 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:11.525588 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e4e985ad-6f44-475b-8c3d-02be8d4ef46a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 202 len: 0 microversion: 2.20 time: 0.344937 Jan 27 16:51:11.526208 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 225/468] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:11 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:11.533603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8412df15-ecb7-4136-93cd-1ea6f998e08b tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 204 len: 0 microversion: 2.1 time: 0.126754 Jan 27 16:51:11.537700 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 244/469] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:11 2022] DELETE /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:11.537842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:11.537842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.549871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:11.550592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.560587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.561499 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.562320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.562760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.570931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.571440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.572949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.573451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.778760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.783954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.786246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f980f328-b372-431a-b16b-fe68d3419e0d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1513 microversion: 2.1 time: 0.247063 Jan 27 16:51:11.786833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 245/470] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:11 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:11.791879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.793437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:11.794598 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-84aefd41-2ec3-4b45-ad94-4e1dd5504c49 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.263518 Jan 27 16:51:11.795138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 226/471] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:11 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:11.857587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:11.858201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:11.865151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.865619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:11.866414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:11.866853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.014024 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:12.027970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-eeb7e881-29c9-41e6-9bbe-c2ba68a7cafc tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1314 microversion: 2.1 time: 0.173234 Jan 27 16:51:12.029163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 246/472] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:11 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:12.066471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:12.067255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:12.075054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.075513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.077048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.077482 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.191414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47b33c5f-d8d0-46e7-a5d9-8c8e1501afeb"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:12.192625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:12.198812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.199414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.200281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.200780 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.230849 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:12.238294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a889ad20-64b0-48a8-b64e-cbb81f03f056 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.175895 Jan 27 16:51:12.238861 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 227/473] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:12 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:12.422729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:12.423384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:12.429723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.430168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.430944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.431372 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.452663 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b301e5c3-dd45-467a-8700-3de10eb07640 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266248 Jan 27 16:51:12.453271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 247/474] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:51:12 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:51:12.575369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:12.584717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fb2b61cd-748c-4f85-ba5a-733c04f0082d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1515 microversion: 2.1 time: 0.166214 Jan 27 16:51:12.585371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 228/475] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:12 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:12.804270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:12.804970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:12.812728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:12.813313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.813687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:12.813795 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.814506 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.815115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.821815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.821815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:12.822566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:12.823007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.046405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.049478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.053959 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cb8f7c53-6536-4a97-9100-4773a46923f7 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1513 microversion: 2.1 time: 0.254874 Jan 27 16:51:13.054521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 248/476] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:12 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:13.057965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.058676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:13.059270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:13.059537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.060806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ccfe9aa6-c42b-43a4-a806-00a523695836 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.251808 Jan 27 16:51:13.061531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 229/477] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:12 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:13.065964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.066416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.067252 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.068311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.201589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.209538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4c9b3e65-88d2-4ca2-b684-f8ada1bb4820 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1498 microversion: 2.1 time: 0.154000 Jan 27 16:51:13.210103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 249/478] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:13 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:13.255511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:13.256253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:13.263179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.263654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.264441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.264874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.393821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:13.402156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-43506cdf-c33d-418c-812b-c19e9b2e9cc5 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.150738 Jan 27 16:51:13.402790 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 230/479] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:13 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:13.786673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:13.787151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:13.793362 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.793811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.794586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.795020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.820351 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:13.899849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-afb2b799-49dc-4037-86ca-168903fe965e tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 204 len: 0 microversion: 2.1 time: 0.116376 Jan 27 16:51:13.900907 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 250/480] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:13 2022] DELETE /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:13.909227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:13.910595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:13.917767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.918541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.919508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.919982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.956780 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:13.957544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:13.963841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.964410 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:13.965299 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:13.965810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.096260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.104334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a68a7e0c-838a-4b34-a255-25b39a5048e9 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1504 microversion: 2.1 time: 0.199097 Jan 27 16:51:14.104905 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 231/481] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:13 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:14.109824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:14.111868 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:14.119067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.119535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.120383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.120817 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.146440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.154162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ffb81c22-4a83-4700-a6b2-965e4a56a07d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1515 microversion: 2.1 time: 0.201268 Jan 27 16:51:14.155294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 251/482] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:13 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:14.160399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:14.161785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:14.170984 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.171616 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.172474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.172907 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.310781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.318474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-590a81ae-355b-4019-8ec0-a8a8cd59a428 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1513 microversion: 2.1 time: 0.212365 Jan 27 16:51:14.319055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 232/483] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:14 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:14.323556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50299ec3-be33-4043-91fa-faf10a5c5cf1"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:14.324665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:14.330859 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.331600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.332565 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.333700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.358307 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.373412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.375405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.377107 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6802556c-b435-4c5b-a8bf-39a706415487 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.220423 Jan 27 16:51:14.378193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 252/484] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:14 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:14.419287 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:14.420133 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:14.426571 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.427073 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.439297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:14.439938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:14.599221 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:14.612268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e53258a8-1375-4282-bdbf-36ef3ea75154 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.196515 Jan 27 16:51:14.613322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 253/485] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:14 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:14.635876 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6123da1b-991c-4c2b-838c-03f42f4f94fa tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315522 Jan 27 16:51:14.636784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 233/486] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:51:14 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:15.012580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-16402aff-739c-4fe7-8f7d-0a2aed2da9ab req-1a784995-3dcd-4365-929d-7a72b6462990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60f03e7b-7a84-4810-9b70-efe8c671c055", "name": "network-vif-deleted", "tag": "b1c27e4d-7b4f-4ebe-a3ea-28060834be45"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:15.014175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:15.014175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:15.023741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-16402aff-739c-4fe7-8f7d-0a2aed2da9ab req-1a784995-3dcd-4365-929d-7a72b6462990 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.024453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-16402aff-739c-4fe7-8f7d-0a2aed2da9ab req-1a784995-3dcd-4365-929d-7a72b6462990 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.035446 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-16402aff-739c-4fe7-8f7d-0a2aed2da9ab req-1a784995-3dcd-4365-929d-7a72b6462990 service nova] Creating event network-vif-deleted:b1c27e4d-7b4f-4ebe-a3ea-28060834be45 for instance 60f03e7b-7a84-4810-9b70-efe8c671c055 on hv-cinder-81883 Jan 27 16:51:15.041761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-16402aff-739c-4fe7-8f7d-0a2aed2da9ab req-1a784995-3dcd-4365-929d-7a72b6462990 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Jan 27 16:51:15.042501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 254/487] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:15.127747 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:15.129102 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:15.136374 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.136815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.137591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.138021 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.273928 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.281116 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fe196b7b-7c5c-4b51-b375-571da0d8d884 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1504 microversion: 2.1 time: 0.162133 Jan 27 16:51:15.281675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 234/488] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:15 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:15.335866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:15.336664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:15.343091 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.343601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.344399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.344859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.378309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.378774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.379266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'fault' on Instance uuid 60f03e7b-7a84-4810-9b70-efe8c671c055 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:15.394611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:15.395353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:15.402181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.402733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.403508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.403956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.419385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.427753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b6cedf62-ce7d-4b82-b7d8-e85a0a23ee98 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 200 len: 1307 microversion: 2.1 time: 0.095555 Jan 27 16:51:15.428385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 255/489] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:15 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:15.543535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.553909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.555402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.556599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-147e23f0-c63a-4572-875f-8e44cd74bff1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.165635 Jan 27 16:51:15.557150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 235/490] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:15 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:15.629672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:15.630435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:15.636932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.637435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.639859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.640321 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.689404 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-ab64a3c9-06e5-4817-9bef-55d2c4c6fdfc req-a5f9b8e1-3c40-41df-bb78-5b18c5744465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6eecd-4759-477d-8484-e510a7638b40", "name": "network-vif-plugged", "status": "completed", "tag": "404e12cf-c62c-4c23-b50c-848e2b404dec"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:15.692257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:15.692257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:15.710886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-ab64a3c9-06e5-4817-9bef-55d2c4c6fdfc req-a5f9b8e1-3c40-41df-bb78-5b18c5744465 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:15.712775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-ab64a3c9-06e5-4817-9bef-55d2c4c6fdfc req-a5f9b8e1-3c40-41df-bb78-5b18c5744465 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:15.730732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-ab64a3c9-06e5-4817-9bef-55d2c4c6fdfc req-a5f9b8e1-3c40-41df-bb78-5b18c5744465 service nova] Creating event network-vif-plugged:404e12cf-c62c-4c23-b50c-848e2b404dec for instance 58a6eecd-4759-477d-8484-e510a7638b40 on hv-cinder-81883 Jan 27 16:51:15.735252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-ab64a3c9-06e5-4817-9bef-55d2c4c6fdfc req-a5f9b8e1-3c40-41df-bb78-5b18c5744465 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049620 Jan 27 16:51:15.736243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 236/491] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:15.816872 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:15.824422 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7824dee0-5ad6-496e-ba4e-b09794f7672b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.198840 Jan 27 16:51:15.824992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 256/492] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:15 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:16.299092 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.299838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.305912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.306356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.307117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.307546 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.373680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:16.382283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-869d045c-035e-4794-846f-f6e61f5276ea tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 200 len: 1462 microversion: 2.1 time: 0.087581 Jan 27 16:51:16.382865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 237/493] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:16 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 1462 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:16.445192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.445809 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 60f03e7b-7a84-4810-9b70-efe8c671c055] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.452390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.453026 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.453888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.454397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.469630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Instance 60f03e7b-7a84-4810-9b70-efe8c671c055 could not be found. Jan 27 16:51:16.470228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 404 to user: Instance 60f03e7b-7a84-4810-9b70-efe8c671c055 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:16.471101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5b7b085a-23d3-424e-a61c-77170e9c5d8d tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055" status: 404 len: 111 microversion: 2.1 time: 0.030526 Jan 27 16:51:16.474614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 257/494] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:16 2022] GET /compute/v2.1/servers/60f03e7b-7a84-4810-9b70-efe8c671c055 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:51:16.479498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.480849 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.486891 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.487368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.488178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.488618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.514584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:16.575138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.575711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.581381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.581828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.583622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.584178 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.596311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-99de4db5-c93b-4826-92ee-a85969bdeb9a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 204 len: 0 microversion: 2.1 time: 0.120064 Jan 27 16:51:16.597752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 238/495] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:16 2022] DELETE /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:16.606543 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.607740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.614734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.615495 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.616738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.617971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.798065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:16.800278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:16.807541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:16.808654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9d6fc1c3-a6b8-4e0d-86e6-bfffe8035248 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1514 microversion: 2.1 time: 0.206454 Jan 27 16:51:16.809448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 239/496] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:16 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:16.809566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:16.810796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-800e604e-fa6c-4224-ac1a-acb7200752d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.239416 Jan 27 16:51:16.811352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 258/497] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:16 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:16.842067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:16.842600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:16.848938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.849844 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.850700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:16.851442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:16.995839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:17.003118 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f185635f-5f15-4c2c-b6ff-fb2834cfe094 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1318 microversion: 2.1 time: 0.164837 Jan 27 16:51:17.003887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 240/498] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:16 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:17.062381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-52646ca4-e381-4b26-9ffb-84d1016024da req-c9dec79c-4a97-4d02-9e2d-7d1931e681a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1", "name": "network-vif-deleted", "tag": "405aa040-774d-4e6f-a24e-9f71de3bfaaa"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:17.066655 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:17.066655 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:17.077911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-52646ca4-e381-4b26-9ffb-84d1016024da req-c9dec79c-4a97-4d02-9e2d-7d1931e681a3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.078568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-52646ca4-e381-4b26-9ffb-84d1016024da req-c9dec79c-4a97-4d02-9e2d-7d1931e681a3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.097332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-52646ca4-e381-4b26-9ffb-84d1016024da req-c9dec79c-4a97-4d02-9e2d-7d1931e681a3 service nova] Creating event network-vif-deleted:405aa040-774d-4e6f-a24e-9f71de3bfaaa for instance 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 on hv-cinder-81883 Jan 27 16:51:17.102580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-52646ca4-e381-4b26-9ffb-84d1016024da req-c9dec79c-4a97-4d02-9e2d-7d1931e681a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047353 Jan 27 16:51:17.103180 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 259/499] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:17.398882 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:17.399417 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:17.405629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.406070 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.406873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.407306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.422856 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] HTTP exception thrown: Instance 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 could not be found. Jan 27 16:51:17.423443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Returning 404 to user: Instance 6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:17.424298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f973d718-dd83-42ea-bf76-d89ce40e6cce tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1" status: 404 len: 111 microversion: 2.1 time: 0.029995 Jan 27 16:51:17.424844 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 241/500] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:17 2022] GET /compute/v2.1/servers/6e4a7a5a-c32b-4e0c-bca9-40cdbca30fb1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:51:17.532647 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1651202874", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "d5d058f3-de8c-4c0f-bf66-49f826de473b"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:17.584049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] validate_networks() for [('d5d058f3-de8c-4c0f-bf66-49f826de473b', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:51:17.825764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:17.826402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:17.832634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.835277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.836142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.836581 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.975691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:51:17.976512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:51:17.977198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:51:17.977846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:51:17.978303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:51:17.988254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.989515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:17.990587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:17.991233 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:18.010141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Getting quotas for project a92d0592f8f14b89a36b145413b2fbe1. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:51:18.014741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Getting quotas for user 8c67a45bdb0d4dcfbd59e88c6eb6f7f5 and project a92d0592f8f14b89a36b145413b2fbe1. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:51:18.022519 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.027613 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:51:18.029865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b492774d-e4f6-4b3e-a25b-36ca9cc1a0a5 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1514 microversion: 2.1 time: 0.207628 Jan 27 16:51:18.030433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 242/501] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:17 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:18.030557 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:51:18.034807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:18.035412 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:18.041213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:18.041676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:18.042494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:18.042930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:18.078955 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c1d2e9d7-0e41-4efc-adb1-3a23e0eeb0ff tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550605 Jan 27 16:51:18.079731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 260/502] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:51:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:51:18.079731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:18.079731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:18.092813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:18.093393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:18.094285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:18.095818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:18.235173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.245326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.248066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.249511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2f42e200-7a36-4791-afd6-48921b2aba4c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.218164 Jan 27 16:51:18.250387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 243/503] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:18 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:18.255708 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0ddd81dd-d182-4601-ad3e-1e8473b64432 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:18.257101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0ddd81dd-d182-4601-ad3e-1e8473b64432 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:18.284018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.291492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c1226bed-a13a-412d-a24f-81e6f36aa628 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1507 microversion: 2.1 time: 0.210748 Jan 27 16:51:18.292092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 261/504] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:18 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:18.311973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0ddd81dd-d182-4601-ad3e-1e8473b64432 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:18.324344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0ddd81dd-d182-4601-ad3e-1e8473b64432 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1214 microversion: 2.1 time: 0.067947 Jan 27 16:51:18.325065 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 244/505] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:18 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:19.046205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:19.047441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:19.054785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.055602 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.056559 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.057141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.090373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.091276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.091754 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lazy-loading 'fault' on Instance uuid f1d239b7-dd50-4a27-9c01-93a05580e612 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:19.117690 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-4a8dfee4-f702-4adb-9437-1c9c0f7cb471 req-206c6e45-b45a-42a4-8951-9be93d920316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d239b7-dd50-4a27-9c01-93a05580e612", "name": "network-vif-deleted", "tag": "18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:19.119344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:19.119344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:19.127248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-4a8dfee4-f702-4adb-9437-1c9c0f7cb471 req-206c6e45-b45a-42a4-8951-9be93d920316 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.127707 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-4a8dfee4-f702-4adb-9437-1c9c0f7cb471 req-206c6e45-b45a-42a4-8951-9be93d920316 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.137319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:19.141198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-4a8dfee4-f702-4adb-9437-1c9c0f7cb471 req-206c6e45-b45a-42a4-8951-9be93d920316 service nova] Creating event network-vif-deleted:18a8caa9-2a86-4e7b-b6f0-e3dc5d2fe716 for instance f1d239b7-dd50-4a27-9c01-93a05580e612 on hv-cinder-81883 Jan 27 16:51:19.147472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-add52704-d71a-4aab-9f02-8bd05dcec6d9 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 200 len: 1307 microversion: 2.1 time: 0.105154 Jan 27 16:51:19.155131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-4a8dfee4-f702-4adb-9437-1c9c0f7cb471 req-206c6e45-b45a-42a4-8951-9be93d920316 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Jan 27 16:51:19.155131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 245/506] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:51:19.155533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 262/507] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:19 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 1307 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:19.269189 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:19.269899 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:19.279206 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.280027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.280791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.281400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.341165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:19.342030 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:19.357814 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.358424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.359243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.359703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:19.460074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:19.474704 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-87377bd2-5c7e-4b0c-9071-61c430ba0560 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1284 microversion: 2.1 time: 0.136799 Jan 27 16:51:19.485815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 263/508] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:19 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:19.503090 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:19.512249 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:19.514225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:19.515529 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b5a6167d-466c-40e1-a718-f2a6d74efcc4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.250714 Jan 27 16:51:19.516238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 246/509] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:19 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:19.982011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-05c38213-95b1-45c2-8e2a-19fd874d15e2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:19.992785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c38213-95b1-45c2-8e2a-19fd874d15e2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:19.993238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c38213-95b1-45c2-8e2a-19fd874d15e2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.067099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-05c38213-95b1-45c2-8e2a-19fd874d15e2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Going to try to stop instance {{(pid=127796) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 27 16:51:20.113653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-05c38213-95b1-45c2-8e2a-19fd874d15e2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 202 len: 0 microversion: 2.1 time: 0.136091 Jan 27 16:51:20.114864 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 264/510] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:19 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:20.123292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:20.123996 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:20.130507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.130999 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.132812 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.133269 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.165273 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:20.166001 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: f1d239b7-dd50-4a27-9c01-93a05580e612] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:20.172101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.172545 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.173326 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.173758 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.191258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Instance f1d239b7-dd50-4a27-9c01-93a05580e612 could not be found. Jan 27 16:51:20.191871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 404 to user: Instance f1d239b7-dd50-4a27-9c01-93a05580e612 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:20.193210 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-34f30a3e-2502-48af-b102-a561fb219309 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612" status: 404 len: 111 microversion: 2.1 time: 0.032673 Jan 27 16:51:20.197084 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 265/511] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:20 2022] GET /compute/v2.1/servers/f1d239b7-dd50-4a27-9c01-93a05580e612 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 27 16:51:20.307774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:20.316442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0cc98a3a-df75-4590-8b99-c866c808f9fc tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.197188 Jan 27 16:51:20.316957 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 247/512] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:20 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:20.500317 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:20.501103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:20.507972 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.508434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.509229 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.509671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.534979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:20.535601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:20.542010 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.542211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.547866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:20.547866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:20.746284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:20.755690 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:20.766339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b546f532-a47f-4175-9b4e-eac2b0cff00f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.277156 Jan 27 16:51:20.766472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:20.766963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 266/513] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:20 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:20.768238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:20.769712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fc286f6c-8fc6-42da-bf25-76aa38caaa5b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.238742 Jan 27 16:51:20.780149 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 248/514] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:20 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:21.170590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-61570fd8-dc2f-4319-a999-8e88cf5e9891 req-999f6461-1706-45ab-9736-db4d9d9387e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f96a1173-38ca-4f56-84b4-823e2284fcef", "tag": "23b59776-3350-45a6-8be5-c4efd77d9022"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:21.173085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:21.173085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:21.180680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-61570fd8-dc2f-4319-a999-8e88cf5e9891 req-999f6461-1706-45ab-9736-db4d9d9387e5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.181125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-61570fd8-dc2f-4319-a999-8e88cf5e9891 req-999f6461-1706-45ab-9736-db4d9d9387e5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.192332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-61570fd8-dc2f-4319-a999-8e88cf5e9891 req-999f6461-1706-45ab-9736-db4d9d9387e5 service nova] Creating event network-changed:23b59776-3350-45a6-8be5-c4efd77d9022 for instance f96a1173-38ca-4f56-84b4-823e2284fcef on hv-cinder-81883 Jan 27 16:51:21.197486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-61570fd8-dc2f-4319-a999-8e88cf5e9891 req-999f6461-1706-45ab-9736-db4d9d9387e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030472 Jan 27 16:51:21.198327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 267/515] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:21.334376 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:21.334994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:21.341148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.341592 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.342490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.342931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.373009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:21.374488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:21.388691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.389142 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.389926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.390356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.417325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:21.485472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:21.498006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-26f80a34-afd5-472c-a5dc-b3d422b44260 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.167862 Jan 27 16:51:21.509524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 249/516] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:21 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:21.518154 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a59fed23-d395-4b28-be9a-31f4815b5c46 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 204 len: 0 microversion: 2.1 time: 0.152262 Jan 27 16:51:21.518739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 268/517] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:21 2022] DELETE /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:21.528600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:21.529221 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:21.535383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.535890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.536670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.537102 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.672421 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:21.680325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9492cedb-6cfd-4be2-ab04-04c3587a4631 tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1514 microversion: 2.1 time: 0.156052 Jan 27 16:51:21.680879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 250/518] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:21 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:21.784453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:21.785172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:21.789585 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:21.790195 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:21.791726 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.792174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.792947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.793378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.795998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.796440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.797203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:21.797652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:21.987202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:21.991003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:21.995050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5fbcb39f-1b14-4cbf-9fab-4c85f7fbfd47 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.214641 Jan 27 16:51:21.995720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 269/519] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:21 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:21.998762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:22.000263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:22.001402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7235b70e-b779-4143-a932-feb53d06610c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.216350 Jan 27 16:51:22.001945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 251/520] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:21 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:22.516350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:22.517033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:22.524601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:22.525102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:22.525960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:22.526401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:22.662958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:22.671815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a80e69dd-be9c-4569-9395-7656f2af553c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.159284 Jan 27 16:51:22.672378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 270/521] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:22 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:22.698584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:22.699198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:22.706238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:22.706774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:22.708424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:22.708964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:22.848890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:22.856178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-739c8691-539e-4f78-975b-c3548818c48e tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1514 microversion: 2.1 time: 0.161621 Jan 27 16:51:22.856741 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 252/522] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:22 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:23.011396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:23.012032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:23.017985 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.018464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.019243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.019732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.021701 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:23.022316 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:23.028552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.028997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.029764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.030195 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.413785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:23.421293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:23.421454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d4f40567-412c-47b2-a1f7-726211790a34 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.413560 Jan 27 16:51:23.421990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 271/523] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:23 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:23.434703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:23.436212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:23.437357 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f0c9167c-e3eb-4d42-9d77-34cadc157aea tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.420537 Jan 27 16:51:23.437900 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 253/524] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:23 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:23.688467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:23.689000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:23.695453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.695922 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.696694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.697123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.828436 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:23.836293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2bc876f8-6892-4e44-a5bc-a88ab0447155 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.151733 Jan 27 16:51:23.836860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 272/525] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:23 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:23.872526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:23.873132 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:23.880148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.880148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:23.881280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:23.881714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.025810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cfe4a71879849b581eb8b48b24107fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598ee83f7e1a494c8b94f241ab626b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:24.036016 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-02d4fa5b-e398-4ab0-844c-078b41e6d7ca tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 200 len: 1514 microversion: 2.1 time: 0.166819 Jan 27 16:51:24.037163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 254/526] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:23 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:24.409121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-5c9ea01f-e1a6-41a1-b7d3-fa411c69057d req-e5fea133-60a4-434c-87a8-447366cfd217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0a7f18-d314-4368-bed8-cb27c0ba466b", "name": "network-vif-deleted", "tag": "edeff32f-9844-440c-a9f3-215374de7bd3"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:24.411193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:24.411193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:24.418633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5c9ea01f-e1a6-41a1-b7d3-fa411c69057d req-e5fea133-60a4-434c-87a8-447366cfd217 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.419074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5c9ea01f-e1a6-41a1-b7d3-fa411c69057d req-e5fea133-60a4-434c-87a8-447366cfd217 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.437816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:24.438674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:24.446027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-5c9ea01f-e1a6-41a1-b7d3-fa411c69057d req-e5fea133-60a4-434c-87a8-447366cfd217 service nova] Creating event network-vif-deleted:edeff32f-9844-440c-a9f3-215374de7bd3 for instance 2a0a7f18-d314-4368-bed8-cb27c0ba466b on hv-cinder-81883 Jan 27 16:51:24.447274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.447755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.448787 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.449373 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.454368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-5c9ea01f-e1a6-41a1-b7d3-fa411c69057d req-e5fea133-60a4-434c-87a8-447366cfd217 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048599 Jan 27 16:51:24.455016 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 273/527] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:24.460551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:24.461235 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:24.468258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.468625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.469427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.470630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.642717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:24.650422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-326a327d-d68e-475c-bdb2-055b7149fb04 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.216151 Jan 27 16:51:24.650988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 255/528] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:24 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:24.671561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:24.679858 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:24.681562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:24.682750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6538db54-f91e-480c-95a7-f19ad908820d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.226382 Jan 27 16:51:24.683309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 274/529] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:24 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:24.853943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:24.854538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:24.860366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.860808 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:24.861568 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:24.861994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.002245 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:25.011499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1b4361bc-4b16-47d2-86e3-4d4b16a77552 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.161178 Jan 27 16:51:25.012099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 256/530] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:24 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:25.055043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:25.055698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] [instance: 2a0a7f18-d314-4368-bed8-cb27c0ba466b] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:25.062579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.063032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.063846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.064302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.078695 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] HTTP exception thrown: Instance 2a0a7f18-d314-4368-bed8-cb27c0ba466b could not be found. Jan 27 16:51:25.079319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] Returning 404 to user: Instance 2a0a7f18-d314-4368-bed8-cb27c0ba466b could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:25.080457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1d7dd613-f41b-449f-9104-9ed144f8520a tempest-AttachVolumeNegativeTest-1324328327 tempest-AttachVolumeNegativeTest-1324328327-project] 10.222.0.48 "GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b" status: 404 len: 111 microversion: 2.1 time: 0.030178 Jan 27 16:51:25.083737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 275/531] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:25 2022] GET /compute/v2.1/servers/2a0a7f18-d314-4368-bed8-cb27c0ba466b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:51:25.666915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:25.667738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:25.674395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.674834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.675950 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.677033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.700884 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:25.701500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:25.707503 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.707987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.713148 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:25.713666 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:25.872973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:25.883403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c4c09212-6aba-4c2d-8305-7f7a6f576ed4 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.220145 Jan 27 16:51:25.884463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 257/532] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:25 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:25.925110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:25.932976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:25.934462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:25.935632 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-923d1784-65a9-4f7f-91ca-06b8f3207ac6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.238498 Jan 27 16:51:25.936188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 276/533] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:25 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:26.030360 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:26.031273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:26.037524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.038064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.038911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.039599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.185647 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:26.195362 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-345b2bf2-4e3a-44bb-87ea-087ec8fcdf15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.168843 Jan 27 16:51:26.205656 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 258/534] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:26 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:26.417260 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:26.418787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:26.425086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.425542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.426370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.426815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.449734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lazy-loading 'flavor' on Instance uuid 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:26.625333 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3ab93815-103e-4c0b-8824-59331469d6d7 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action" status: 200 len: 32 microversion: 2.1 time: 0.212209 Jan 27 16:51:26.625938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 277/535] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:26 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:51:26.635466 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:26.636181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:26.642846 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.643294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.644491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.645580 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.792300 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:26.802369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-34baf8ce-5442-4c0d-a6e5-4598035e03a8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.170624 Jan 27 16:51:26.803308 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 259/536] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:26 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:26.901239 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:26.902037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:26.908163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.908713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.909617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.910151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.954086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:26.954798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:26.967781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.968225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:26.969019 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:26.969448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.145442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.153966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-afe0978a-452f-4891-8517-6df9b5a3c53b tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.256733 Jan 27 16:51:27.156417 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 278/537] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:26 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:27.192593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.206860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.208949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.210123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c7791b11-e3b1-4f18-b881-b29da85e58d2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.259756 Jan 27 16:51:27.212787 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:27.213613 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:27.219946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:27.220464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.221293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 260/538] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:26 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:27.221442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:27.221866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.377590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.385539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-37addc34-0c72-4780-b243-53973f93a787 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.176598 Jan 27 16:51:27.386199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 279/539] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:27 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:27.649443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-6d5d65d2-ce5b-4547-9f28-82b7b311c3dd req-06c983a1-7205-4681-aaec-6ae32d5c6d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96a1173-38ca-4f56-84b4-823e2284fcef", "name": "network-vif-plugged", "status": "completed", "tag": "23b59776-3350-45a6-8be5-c4efd77d9022"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:27.651096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:27.651096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:27.658617 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-6d5d65d2-ce5b-4547-9f28-82b7b311c3dd req-06c983a1-7205-4681-aaec-6ae32d5c6d1c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:27.659166 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-6d5d65d2-ce5b-4547-9f28-82b7b311c3dd req-06c983a1-7205-4681-aaec-6ae32d5c6d1c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.674725 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-6d5d65d2-ce5b-4547-9f28-82b7b311c3dd req-06c983a1-7205-4681-aaec-6ae32d5c6d1c service nova] Creating event network-vif-plugged:23b59776-3350-45a6-8be5-c4efd77d9022 for instance f96a1173-38ca-4f56-84b4-823e2284fcef on hv-cinder-81883 Jan 27 16:51:27.680937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-6d5d65d2-ce5b-4547-9f28-82b7b311c3dd req-06c983a1-7205-4681-aaec-6ae32d5c6d1c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035888 Jan 27 16:51:27.681653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 261/540] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:27.820981 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:27.822253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:27.828824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:27.829274 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.830054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:27.830485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:27.973213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:27.981158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3f829c2f-5274-43ea-97ff-08023cd74d3c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.164953 Jan 27 16:51:27.981720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 280/541] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:27 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:28.175676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:28.177306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:28.183744 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.184194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.184974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.185400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.229547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:28.230225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:28.237053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.237566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.238735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.239164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.358830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:28.367351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ea389254-613a-459f-ba35-ce8f1df64d8f tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1314 microversion: 2.1 time: 0.198619 Jan 27 16:51:28.367952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 262/542] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:28 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:28.402227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:28.402877 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:28.403761 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:28.408692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.409133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.410024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:28.411110 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:28.412268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:28.413779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:28.414947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ab12c9fa-a59a-4cba-82c5-78ef36d1a97d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.189615 Jan 27 16:51:28.417085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 281/543] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:28 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:28.550693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:28.559232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7f03e255-3c3d-47f5-90a9-920848d66511 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.160618 Jan 27 16:51:28.559861 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 263/544] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:28 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:28.643113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-13453537", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1061823013", "security_groups": [{"name": "tempest-secgroup-smoke-1190761061"}], "networks": [{"uuid": "05347023-7f45-4941-9645-f74845d1ff41"}], "block_device_mapping_v2": [{"uuid": "e8716095-43ca-4a96-9ce7-7384eee2e70b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:28.757706 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] validate_networks() for [('05347023-7f45-4941-9645-f74845d1ff41', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:51:28.998256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:28.998864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:29.004629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.005075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.005845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.006280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.185662 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:51:29.186164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:51:29.186493 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:51:29.187164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:51:29.187605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:51:29.196936 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.197657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.198611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.199062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.210405 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.216810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:51:29.221255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Getting quotas for user d1189e6ca83149dc95cc1a54c3c31421 and project 5c13f9d51cfe44de91903d2de6032c92. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:51:29.223502 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-35887a28-3e48-427a-b656-2d2ae82b7e44 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.228245 Jan 27 16:51:29.224354 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 264/545] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:28 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:29.283365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:51:29.286927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8716095-43ca-4a96-9ce7-7384eee2e70b',volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:51:29.384292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:29.385643 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:29.399411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.400318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.402334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.404546 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.474067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2fa3b8f5-3121-4c1c-994d-bd10dd767c9d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833697 Jan 27 16:51:29.479416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 282/546] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:51:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:51:29.479416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:29.479850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:29.488408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.488865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.489657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.492286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.627190 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.636172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-87b1bebb-3581-422d-99a7-3105f8448a80 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1498 microversion: 2.1 time: 0.255540 Jan 27 16:51:29.636835 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 265/547] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:29 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1498 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:29.641965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-988538c5-d8ce-47cf-a85f-ca9cca368da3 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:29.642817 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-988538c5-d8ce-47cf-a85f-ca9cca368da3 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:29.691387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.700731 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.702499 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.703949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-12d9f104-3a8e-4f7a-830e-204b6dccb0d3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.228153 Jan 27 16:51:29.704680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 283/548] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:29 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:29.709895 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-988538c5-d8ce-47cf-a85f-ca9cca368da3 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.710585 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:29.711374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:29.718558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-988538c5-d8ce-47cf-a85f-ca9cca368da3 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1087 microversion: 2.1 time: 0.079737 Jan 27 16:51:29.719052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 266/549] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:29 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1087 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:29.720339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.720977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.721775 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:29.722278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:29.881679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:29.890760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f6763de4-412d-408e-9934-c9d30dea8c79 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.184853 Jan 27 16:51:29.891707 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 284/550] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:29 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:30.240566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:30.241197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:30.247477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.247955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.248723 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.249158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.380494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:30.388238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-55c4de19-50fd-456c-9189-7868b46d2ed0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.151538 Jan 27 16:51:30.388806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 267/551] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:30 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:30.724440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:30.725067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:30.730946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.731446 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.732250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.732678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.736520 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:30.737165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:30.743436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.743917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.744691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.745125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.817204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:30.824539 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-72207b6a-867f-4514-ace3-d72185ad0031 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1137 microversion: 2.1 time: 0.091853 Jan 27 16:51:30.825107 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 268/552] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:30 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:30.882118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:30.889824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:30.891339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:30.892550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-182f5180-f18e-4f17-9474-c62e26a62167 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.171958 Jan 27 16:51:30.893109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 285/553] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:30 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:30.908972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:30.909584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:30.915903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.916431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:30.917409 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:30.917840 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.046324 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:31.054594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e9452287-59e0-4da5-ab9a-194d18f4b41a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.149292 Jan 27 16:51:31.055155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 269/554] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:30 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:31.405723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:31.406335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:31.413090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.413541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.414305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.414735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.544543 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:31.552958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-756d3342-cad6-45d7-863d-a2df85938c8a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.150759 Jan 27 16:51:31.553530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 286/555] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:31 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:31.840550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:31.841189 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:31.847532 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.848503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.849413 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.849842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.906219 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:31.909879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:31.911025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:31.914310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a43e714b-f41e-40e4-9cef-3c3b40c0f137 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1137 microversion: 2.1 time: 0.077328 Jan 27 16:51:31.914875 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 270/556] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:31 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:31.918133 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.918588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:31.919376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:31.919840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.047871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:32.056128 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:32.057617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:32.058768 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f81c334b-b87e-41fb-a4cf-7faee64008d1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.152554 Jan 27 16:51:32.059326 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 287/557] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:31 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:32.071182 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:32.071813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:32.077492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.077934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.078692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.079120 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.204856 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:32.213084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-709c9d58-a87e-4bc7-b138-efc920545272 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.145467 Jan 27 16:51:32.213640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 271/558] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:32 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:32.570398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:32.571320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:32.577215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.577846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.578796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.579382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.724794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:32.737828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cb815434-ea01-4662-9438-8d7c6670534c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.171622 Jan 27 16:51:32.739429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 288/559] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:32 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:32.848271 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:32.848852 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:32.855044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.855582 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.856437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.856904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.882209 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:51:32.930911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:32.931471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:32.939697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.940147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.940951 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.941375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.956411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1fbcfd8a-d46d-4324-a374-f7c6e51f6702 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 204 len: 0 microversion: 2.1 time: 0.111971 Jan 27 16:51:32.957499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 272/560] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:51:32 2022] DELETE /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:32.966661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:32.967823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:32.975078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.975871 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:32.976668 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:32.977142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.010213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.019507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c76f8959-ed75-4f98-91c7-ef510e22c0d9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1185 microversion: 2.1 time: 0.092268 Jan 27 16:51:33.020374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 289/561] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:32 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:33.076388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:33.077955 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:33.084433 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.085202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.086140 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.086811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.120078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.129850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4adf9c92-3ac1-4528-93a3-173cd6429c33 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1504 microversion: 2.1 time: 0.166036 Jan 27 16:51:33.132128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 273/562] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:32 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:33.232143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:33.233233 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:33.241017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.241807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.242843 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.243765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.250833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.260527 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.262293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.264199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8c2d4524-3cc8-4d65-8123-07c1993887bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.191238 Jan 27 16:51:33.265077 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 290/563] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:33 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:33.385235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.392884 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-307eb72d-78a0-433d-976e-611354d43944 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.166530 Jan 27 16:51:33.393467 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 274/564] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:33 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:33.759487 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:33.760044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:33.767392 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.768012 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.768827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:33.769295 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:33.944991 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:33.955709 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f87aaa9d-a535-4adc-915f-5256e7f1bba5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.202364 Jan 27 16:51:33.956749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 291/565] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:33 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:34.037674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:34.038358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:34.047369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.048217 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.049027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.049457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.149029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:34.149894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:34.156544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.159380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.162350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.162835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.242797 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.251842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e191a561-dba5-42ca-838f-f9810c562f39 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.217665 Jan 27 16:51:34.252419 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 275/566] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:34 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:34.282934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:34.283675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:34.291648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.292363 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.293178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.293583 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.348224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.357766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a1c6b0e9-744d-40ed-a7d8-faac34f4e822 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1504 microversion: 2.1 time: 0.212986 Jan 27 16:51:34.358343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 292/567] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:34 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:34.412975 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:34.413688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:34.420949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.421598 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.422921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.424956 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.453615 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.469122 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.471197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.474045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5d4eca4b-f9a4-4b14-b76c-b48a01309328 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1742 microversion: 2.20 time: 0.195005 Jan 27 16:51:34.479186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 276/568] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:34 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:34.606549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:34.615127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-301f7019-7759-4ac9-a382-63b7f6bd9c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.208267 Jan 27 16:51:34.615956 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 293/569] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:34 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:34.677884 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-9955aa7c-ad5d-4bdd-8c77-bd8af62f0f55 req-41a99460-3d85-4ee7-8f93-b3cd833d16c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:34.680678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:34.680678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:34.693001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-9955aa7c-ad5d-4bdd-8c77-bd8af62f0f55 req-41a99460-3d85-4ee7-8f93-b3cd833d16c3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.693608 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-9955aa7c-ad5d-4bdd-8c77-bd8af62f0f55 req-41a99460-3d85-4ee7-8f93-b3cd833d16c3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.710803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-9955aa7c-ad5d-4bdd-8c77-bd8af62f0f55 req-41a99460-3d85-4ee7-8f93-b3cd833d16c3 service nova] Creating event network-changed:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:51:34.722319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-9955aa7c-ad5d-4bdd-8c77-bd8af62f0f55 req-41a99460-3d85-4ee7-8f93-b3cd833d16c3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048447 Jan 27 16:51:34.725442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 277/570] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:34.973642 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:34.974334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:34.980820 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.981267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:34.982052 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:34.982484 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.150105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.158906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c8e9526d-b051-443d-9601-b4abadfc5707 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.189328 Jan 27 16:51:35.160100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 294/571] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:34 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:35.271158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:35.271948 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:35.278023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.278469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.279247 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.279704 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.381350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:35.381979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:35.387854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.388550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.389789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.390232 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.418909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.429609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-455d58cd-544e-402d-bdff-8b4762530ed4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.164018 Jan 27 16:51:35.439351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 278/572] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:35 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:35.500756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:35.501767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:35.508599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.509043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.509833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.510299 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.567842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.581834 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a806fd26-6179-49e5-a431-c04442599447 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1504 microversion: 2.1 time: 0.207120 Jan 27 16:51:35.593092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 295/573] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:35 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:35.633054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:35.633820 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:35.651255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.651746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.652557 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:35.652996 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:35.704043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.714427 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.716109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.717818 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ef3041da-8b86-4041-ae93-ea044ff9efac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1742 microversion: 2.20 time: 0.224879 Jan 27 16:51:35.729081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 279/574] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:35 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1742 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:35.813448 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:35.822378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-59d0fbd2-cc85-413d-9669-64a34b5f4f50 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.193660 Jan 27 16:51:35.832089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 296/575] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:35 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:36.176064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:36.176880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:36.183263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.183751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.184533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.184961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.340413 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.350813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-212d2108-0ccf-4451-b090-9a46d76c7fe2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.178542 Jan 27 16:51:36.351631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 280/576] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:36 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:36.445893 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:36.446512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:36.452880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.453331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.454113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.454549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.600947 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:36.601559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:36.607848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.608330 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.609105 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.609980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.612409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.622213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19c8635c-e0e2-4d01-ac84-a78145dd48c0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.180065 Jan 27 16:51:36.623174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 297/577] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:36 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:36.662384 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.662824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.663270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lazy-loading 'fault' on Instance uuid f96a1173-38ca-4f56-84b4-823e2284fcef {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:51:36.710474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a92d0592f8f14b89a36b145413b2fbe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.720896 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a326567f-7fb8-4ba5-85a2-6e4902609683 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 200 len: 1304 microversion: 2.1 time: 0.125090 Jan 27 16:51:36.722054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 281/578] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:36 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:36.736926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:36.737691 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:36.738174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-2366a39c-9dbb-457b-b0fa-d61bf16c8776 req-4ee5dcb0-88e0-4c84-9780-2453e82d261e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f96a1173-38ca-4f56-84b4-823e2284fcef", "name": "network-vif-deleted", "tag": "23b59776-3350-45a6-8be5-c4efd77d9022"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:36.740499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:36.740499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:36.745436 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.746017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.746910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.747446 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.747894 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-2366a39c-9dbb-457b-b0fa-d61bf16c8776 req-4ee5dcb0-88e0-4c84-9780-2453e82d261e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.748334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-2366a39c-9dbb-457b-b0fa-d61bf16c8776 req-4ee5dcb0-88e0-4c84-9780-2453e82d261e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.765044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-2366a39c-9dbb-457b-b0fa-d61bf16c8776 req-4ee5dcb0-88e0-4c84-9780-2453e82d261e service nova] Creating event network-vif-deleted:23b59776-3350-45a6-8be5-c4efd77d9022 for instance f96a1173-38ca-4f56-84b4-823e2284fcef on hv-cinder-81883 Jan 27 16:51:36.772461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-2366a39c-9dbb-457b-b0fa-d61bf16c8776 req-4ee5dcb0-88e0-4c84-9780-2453e82d261e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036986 Jan 27 16:51:36.773821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 282/579] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:36.840660 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:36.841358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:36.859465 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.860220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.861204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:36.861705 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:36.955715 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.971174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.981127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:36.982606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4bc4f188-f7c2-495c-a253-15aae6b207c6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.249564 Jan 27 16:51:36.983169 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 298/580] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:36 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:37.087399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:37.099978 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-714069cf-b1ab-4549-9906-0da78bdddb26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.263727 Jan 27 16:51:37.100770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 283/581] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:36 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:37.372682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:37.373572 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:37.381550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.382296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.383692 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.384285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.585133 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:37.594036 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b3466207-d1de-49bb-994a-702ae1ed32df tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.229531 Jan 27 16:51:37.599803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 299/582] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:37 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:37.639394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:37.640911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:37.654132 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.654532 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.655464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.655987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.740068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:37.740693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] [instance: f96a1173-38ca-4f56-84b4-823e2284fcef] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:37.753564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.754092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.754912 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.755349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.805222 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] HTTP exception thrown: Instance f96a1173-38ca-4f56-84b4-823e2284fcef could not be found. Jan 27 16:51:37.806356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] Returning 404 to user: Instance f96a1173-38ca-4f56-84b4-823e2284fcef could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:51:37.809925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-76351202-e611-4f4b-8b88-64169861bbe0 tempest-VolumesActionsTest-1649066442 tempest-VolumesActionsTest-1649066442-project] 10.222.0.48 "GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef" status: 404 len: 111 microversion: 2.1 time: 0.075049 Jan 27 16:51:37.812690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 300/583] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:37 2022] GET /compute/v2.1/servers/f96a1173-38ca-4f56-84b4-823e2284fcef => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:51:37.822858 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-82289c52-2c59-4bc1-ac13-55a657355db7 req-dd4ee94b-2f7d-4ffd-9ce4-55e75fb2425d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "name": "network-vif-plugged", "status": "completed", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:37.828836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:37.828836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:37.844707 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-82289c52-2c59-4bc1-ac13-55a657355db7 req-dd4ee94b-2f7d-4ffd-9ce4-55e75fb2425d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:37.848225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-82289c52-2c59-4bc1-ac13-55a657355db7 req-dd4ee94b-2f7d-4ffd-9ce4-55e75fb2425d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:37.877118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-82289c52-2c59-4bc1-ac13-55a657355db7 req-dd4ee94b-2f7d-4ffd-9ce4-55e75fb2425d service nova] Creating event network-vif-plugged:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:51:37.887353 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-82289c52-2c59-4bc1-ac13-55a657355db7 req-dd4ee94b-2f7d-4ffd-9ce4-55e75fb2425d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071445 Jan 27 16:51:37.890256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 301/584] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:37.987874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:37.999515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b9897585-2471-4bf9-b826-8be5f1b6888b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.363691 Jan 27 16:51:38.003389 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:38.003389 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:38.016040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 284/585] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:37 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:38.017847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.018304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.019111 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.019628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.124126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:38.127551 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:38.141516 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.141961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.142743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.143165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.311509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:38.324151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:38.328189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:38.329579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c5ca9db7-7a3e-41b0-a566-2ed142a92606 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.331667 Jan 27 16:51:38.333587 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 302/586] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:37 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:38.467440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:38.478278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5c032889-6ab0-4d75-93b0-406d55a756c4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.364433 Jan 27 16:51:38.479604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 285/587] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:38 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:38.617110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:38.617783 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:38.624718 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.625155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.625996 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:38.626661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:38.824179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:38.838638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-170c0c58-f0f7-4837-9519-856a39876053 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.226035 Jan 27 16:51:38.847880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 303/588] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:38 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:39.019600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:39.022099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:39.028607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.029037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.030038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.030470 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.181560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:39.190193 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d296b0af-ce71-4edd-9531-37668680e559 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.173503 Jan 27 16:51:39.190994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 286/589] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:39 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:39.350412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:39.351134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:39.357619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.358540 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.359900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.360531 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.495765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:39.496262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:39.519213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.519824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.521292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.521887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.531320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:39.547995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:39.551661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:39.553137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3abb2404-b473-44ed-b674-6337e18e4d81 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.207075 Jan 27 16:51:39.554275 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 304/590] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:39 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:39.694301 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:39.704673 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9f41caac-c7b9-442a-b4bf-b6fac9afc7e7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.213066 Jan 27 16:51:39.705889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 287/591] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:39 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:39.860426 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:39.861041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:39.868660 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.869379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:39.870357 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:39.870953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.113285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.121970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7acdc27f-635c-478a-a79b-7e47da116305 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.265138 Jan 27 16:51:40.122856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 305/592] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:39 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:40.209042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:40.210857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:40.219918 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.220920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.222828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.223729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.437101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.444945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-696beecb-90dc-4044-afea-b24c3c9ef2df tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.241181 Jan 27 16:51:40.445524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 288/593] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:40 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:40.572101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:40.572708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:40.579114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.579560 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.580371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.580808 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.728229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:40.728854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:40.746692 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.748438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.749285 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:40.749733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:40.798278 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.811816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.813698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.815545 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-975abf07-8f8d-462f-8e33-08ecb8ea4589 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.247229 Jan 27 16:51:40.820654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 306/594] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:40 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:40.964473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:40.974037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f0d15e87-e6be-4d66-84f2-4b553af54081 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.253288 Jan 27 16:51:40.974642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 289/595] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:40 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:41.139363 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:41.140733 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:41.153927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.154387 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.155377 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.155844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.323113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:41.333288 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7beb096a-7df7-41a0-b948-b74064119900 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.197440 Jan 27 16:51:41.344490 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 307/596] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:41 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:41.463108 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:41.464463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:41.471416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.471902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.472960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.473563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.716537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:41.727295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b9cfa185-9b19-485f-aec6-dea742cb4a10 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.268436 Jan 27 16:51:41.728574 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 290/597] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:41 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:41.839654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:41.841068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:41.848201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.848950 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.850710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:41.851368 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:41.992545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:41.993301 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:42.003014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.003525 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.004732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.005246 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.015892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.042153 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.043698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.044927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-15029425-473c-4650-8096-4f134d138581 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.209880 Jan 27 16:51:42.059931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 308/598] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:41 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:42.212227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.226765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3d927ee1-3eae-4338-9107-ef89fb02d979 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.238980 Jan 27 16:51:42.238356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 291/599] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:41 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:42.352912 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:42.354374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:42.361427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.362144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.363962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.365116 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.549508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.569234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9030bbd7-21ba-4eaf-9d84-2c4add248f31 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.222508 Jan 27 16:51:42.569826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 309/600] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:42 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:42.746203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:42.747523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:42.755406 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.756354 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.757376 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:42.757807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:42.940636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:42.966133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-09bfae5e-e409-4c9d-b3d0-5a878b81d06e tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.224537 Jan 27 16:51:42.966640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 292/601] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:42 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:43.063315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:43.064121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:43.071518 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.072597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.073392 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.078785 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.244515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:43.245162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:43.251160 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.251879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.252891 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.253514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.280752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:43.293374 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:43.294875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:43.298579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-65cc3dc4-36d3-45f4-8e68-760b8c4a34e6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.239036 Jan 27 16:51:43.299452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 310/602] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:43 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:43.407666 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:43.416822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2a1777d9-a68f-49e9-942a-d99bc6cb96f3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.175884 Jan 27 16:51:43.417399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 293/603] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:43 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:43.586638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:43.587248 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:43.593865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.594312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.595864 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:43.596303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:43.736158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:43.744880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-40dad36c-ac1e-4109-84a7-24e032e6cd0c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.161841 Jan 27 16:51:43.745456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 311/604] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:43 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:44.027806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:44.028956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:44.039581 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.040295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.041248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.041829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.299442 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:44.317186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5b2d301d-54f0-4642-99f8-f23c1884d116 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.323792 Jan 27 16:51:44.321152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:44.322036 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:44.327798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 294/605] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:43 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:44.331129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.331723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.332514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.332950 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.441910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:44.443940 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:44.468368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.471276 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.472708 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.473366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.774072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:44.783619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:44.789940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:44.807981 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-189283cf-b115-4980-9b48-ed827c5ad08b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.492173 Jan 27 16:51:44.812375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 312/606] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:44 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:44.841262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:44.842122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:44.864713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.867136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.869263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:44.869902 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:44.919867 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:44.929389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f183080c-2c84-4ae1-956a-ebe995465685 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.498004 Jan 27 16:51:44.930148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 295/607] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:44 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:45.191909 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:45.206043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fc474e37-8f47-4c8a-ab4c-ad3a9e7b2f21 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.392294 Jan 27 16:51:45.208267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 313/608] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:44 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:45.334589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:45.335889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:45.351343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.351957 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.352631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.353155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.384898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80c489d7-af75-45fa-a760-5f7704a99fec", "device": "/dev/sdb"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:45.386459 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:45.400728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.401165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.401968 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.402408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.640237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:45.660504 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-111fcc92-64c8-4e05-aa38-188b077d671a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.325264 Jan 27 16:51:45.664636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 296/609] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:45 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:45.828290 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:45.829173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:45.852023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.852742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.853728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.854331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.918677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-48421e68-b4a8-44c7-92e0-80d82a1eb94a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "POST /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530987 Jan 27 16:51:45.929582 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 314/610] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:51:45 2022] POST /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:45.949964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:45.960117 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:45.992291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.992751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:45.997393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:45.999239 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:46.328422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:46.348424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:46.358309 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:46.366010 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-67b0d741-88dc-4a07-b3fe-a4ea0e777827 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.541380 Jan 27 16:51:46.368920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 297/611] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:45 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:46.387443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:46.389555 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:46.423625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:46.426426 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:46.429125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:46.433678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:46.720702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:46.730107 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-45b899fc-73b7-42ce-b619-d62fedb9c2be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1723 microversion: 2.1 time: 0.784910 Jan 27 16:51:46.740895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 315/612] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:45 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1723 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:46.761535 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:46.779140 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:46.799918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:46.800980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:46.801850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:46.802288 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:47.337905 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:47.345964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9a1d4cef-4fd2-43a2-bd22-51196db8e57a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.974641 Jan 27 16:51:47.346540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 298/613] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:46 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:47.386251 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:47.387649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:47.397842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:47.398556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:47.401046 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:47.404952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:47.516376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:47.530213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25d5ec5b-e7c0-4c9c-be52-685af95bd6b0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.785572 Jan 27 16:51:47.531366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 316/614] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:46 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:47.802976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:47.803626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:47.836053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:47.836577 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:47.838057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:47.838798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:47.865779 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:47.905864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:47.914402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:47.956864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a35ab49a-8fc1-4143-842a-8cd679a091dc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.554563 Jan 27 16:51:47.978987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 299/615] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:47 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:48.251076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:48.268042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-67bc1a68-f5f2-433e-ac6f-57f30a645d4e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1700 microversion: 2.1 time: 0.469326 Jan 27 16:51:48.280372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 317/616] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:47 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1700 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:48.298335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cbfbd84c-280c-4232-b43a-12e86cdcb5ab tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:48.305980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cbfbd84c-280c-4232-b43a-12e86cdcb5ab tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.307293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cbfbd84c-280c-4232-b43a-12e86cdcb5ab tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.366671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:48.367628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:48.391080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.391872 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.392859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.393461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.524929 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cbfbd84c-280c-4232-b43a-12e86cdcb5ab tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Going to try to start instance {{(pid=127795) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 27 16:51:48.610718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cbfbd84c-280c-4232-b43a-12e86cdcb5ab tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 202 len: 0 microversion: 2.1 time: 0.317877 Jan 27 16:51:48.618154 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 300/617] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:51:48 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:51:48.621085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:48.621795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:48.629987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.630358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.631170 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.631698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.676896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:48.688979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-34ed388c-e271-4d4d-9a1f-1f08c00c9766 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.326671 Jan 27 16:51:48.710486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 318/618] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:48 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:48.728402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:48.729030 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:48.756873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.758313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.759895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:48.767741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:48.975478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:48.985536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-43ea2ab8-0392-4640-8084-11b5975b9f28 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.370185 Jan 27 16:51:48.987408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 301/619] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:48 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:48.995367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:48.996009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:49.010829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:49.011082 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:49.012296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:49.012724 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:49.211789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:49.245708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-30a5d882-191b-4cb6-ab31-af34c233df9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1709 microversion: 2.1 time: 0.528774 Jan 27 16:51:49.247696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 319/620] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:48 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1709 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:49.354803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:49.378696 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:49.424577 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:49.444561 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6c07214c-ef64-42f1-a225-8de87b1e1fb0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.449429 Jan 27 16:51:49.447096 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 302/621] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:48 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:49.712419 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:49.713529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:49.734987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:49.736841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:49.742118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:49.744984 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.002260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:50.002877 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:50.018971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.024594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.025661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.026229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.154197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.168616 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b8e11496-dbe3-4421-804e-f016489d1a02 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.465584 Jan 27 16:51:50.178542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 320/622] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:49 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:50.263822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:50.264739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:50.274090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.274882 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.275904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.277072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.389549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.401616 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c6212377-b98f-4af2-89bb-7e38bd61b390 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.403035 Jan 27 16:51:50.404587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 303/623] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:49 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:50.463280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:50.464017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:50.476238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.476699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.477511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.484187 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.720894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.736956 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9ed594e7-673c-43f8-8789-56b2e7778a18 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1709 microversion: 2.1 time: 0.476717 Jan 27 16:51:50.739987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 321/624] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:50 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1709 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:50.750715 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-bab57a29-8c6c-485f-98cd-178065983309 req-04ddcb5d-b4b9-438a-9749-c14837290e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "name": "network-vif-plugged", "status": "completed", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:50.755949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:50.755949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:50.772503 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-bab57a29-8c6c-485f-98cd-178065983309 req-04ddcb5d-b4b9-438a-9749-c14837290e38 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:50.772947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-bab57a29-8c6c-485f-98cd-178065983309 req-04ddcb5d-b4b9-438a-9749-c14837290e38 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:50.804714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-bab57a29-8c6c-485f-98cd-178065983309 req-04ddcb5d-b4b9-438a-9749-c14837290e38 service nova] Creating event network-vif-plugged:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:51:50.813597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-bab57a29-8c6c-485f-98cd-178065983309 req-04ddcb5d-b4b9-438a-9749-c14837290e38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071470 Jan 27 16:51:50.816310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 322/625] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:50.928586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.947901 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.949661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:50.955238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3e57d33a-745b-4b5b-abf3-e16c1c157559 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.495849 Jan 27 16:51:50.968924 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 304/626] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:50 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:51:51.187769 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:51.188474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:51.198745 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.199812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.203876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.205367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.421355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:51.423041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:51.441152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.441920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.445201 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.445661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.601946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:51.613789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-36c209e0-248f-4135-be47-c69e7fbf6208 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.428387 Jan 27 16:51:51.615698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 323/627] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:51 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:51.757399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:51.758200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:51.759064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:51.768042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.769126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.769893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c6d59b39-9a4c-48b3-b06d-aa422513c19b tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.353277 Jan 27 16:51:51.770766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.771559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 305/628] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:51 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:51.780240 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.959845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:51.975120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-62efcc8b-2e66-45ad-b156-16ddaf213ba5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1713 microversion: 2.1 time: 0.222385 Jan 27 16:51:51.977521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 324/629] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:51 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1713 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:51.978899 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:51.979601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:51.990636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.991175 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:51.992216 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:51.993760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:52.224359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:52.238935 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:52.247736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:52.250180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bd203a7f-2010-4c1c-b2a7-7621e702cbd7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1737 microversion: 2.20 time: 0.279252 Jan 27 16:51:52.251344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 306/630] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:51 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:52.630684 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:52.631646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:52.638521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:52.639290 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:52.640309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:52.640959 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:52.795922 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:52.820975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:52.830327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:52.842062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-693e75e5-774e-42cb-92fe-235804db474f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.215618 Jan 27 16:51:52.844306 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 325/631] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:52 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:52.845901 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:52.848123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:52.850609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:52.851119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:53.049262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:53.061719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9b9fca42-b851-439a-b67e-8362e81ecfaf tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1259 microversion: 2.1 time: 0.278117 Jan 27 16:51:53.062385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 307/632] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:52 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1259 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:53.289918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:53.291517 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:53.300460 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:53.301730 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:53.302986 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:53.303807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:53.516032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:53.526054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:53.528842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:53.530076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-da09408b-5f17-4f80-8f26-7bd6ab25b2d0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1719 microversion: 2.20 time: 0.263510 Jan 27 16:51:53.542619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 326/633] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:53 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1719 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:53.860903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:53.861675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:53.868428 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:53.868877 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:53.869649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:53.870077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.050212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.058830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-56520f70-cf69-4eef-be31-b7897184e05b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.201519 Jan 27 16:51:54.059991 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 308/634] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:53 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:54.079204 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:54.079866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:54.091911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.092367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.093159 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.093808 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.300115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.307728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-155147bc-6dfc-4c57-ab1c-dd8f301b03d0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1442 microversion: 2.1 time: 0.232817 Jan 27 16:51:54.319743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 327/635] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:54 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1442 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:54.328497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:54.329317 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:54.342834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.343268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.344066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.344491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.531438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.539946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9ab8da37-2775-4a3f-a405-9d811ef23fdb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1442 microversion: 2.1 time: 0.214874 Jan 27 16:51:54.540860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 309/636] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:54 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1442 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:54.557812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:54.559636 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:54.568456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.569176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.570833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:54.571525 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:54.808883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.818134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.819747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:54.821122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-915ffaa4-6a8d-4edc-99a2-dd7324412f0c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1719 microversion: 2.20 time: 0.266822 Jan 27 16:51:54.822015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 328/637] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:54 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1719 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:55.076254 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:55.077631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:55.084818 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:55.085559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:55.086614 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:55.087234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:55.368071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:55.381305 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-deaf0b29-ac21-46c4-b24c-29936df0298f tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.308676 Jan 27 16:51:55.383403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 310/638] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:55 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:55.842298 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:55.843780 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:55.855437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:55.856280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:55.859266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:55.861425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:56.076170 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-1ab17264-9146-438a-b7aa-25f9d77db92a req-e2768155-a09d-469c-84ba-4b8c74d23770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "name": "network-vif-unplugged", "status": "completed", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:56.078630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:56.078630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:51:56.099129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-1ab17264-9146-438a-b7aa-25f9d77db92a req-e2768155-a09d-469c-84ba-4b8c74d23770 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:56.099962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-1ab17264-9146-438a-b7aa-25f9d77db92a req-e2768155-a09d-469c-84ba-4b8c74d23770 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:56.123653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-1ab17264-9146-438a-b7aa-25f9d77db92a req-e2768155-a09d-469c-84ba-4b8c74d23770 service nova] Creating event network-vif-unplugged:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:51:56.133626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-1ab17264-9146-438a-b7aa-25f9d77db92a req-e2768155-a09d-469c-84ba-4b8c74d23770 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061409 Jan 27 16:51:56.135071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 311/639] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:51:56.201129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:56.212708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:56.214211 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:56.217312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-883723ee-c1cc-4747-ab65-cd18533931fa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1719 microversion: 2.20 time: 0.379174 Jan 27 16:51:56.217876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 329/640] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:55 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1719 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:56.400582 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:56.401542 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:56.409389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:56.410105 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:56.411210 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:56.411931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:56.741066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:56.752648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-71f5618f-9292-450a-b0a4-12f3c80abfe5 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.356365 Jan 27 16:51:56.762010 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 312/641] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:56 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:57.236381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:57.237171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:57.245555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:57.246007 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:57.251439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:57.252065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:57.749420 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:57.770381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:57.771718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:57.777070 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:57.779113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:57.781505 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:57.782985 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1a85b25b-b58d-40f6-8d92-1df6baaecfc1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1719 microversion: 2.20 time: 0.550253 Jan 27 16:51:57.783698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:57.785675 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 330/642] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:57 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1719 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:57.786152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:57.786944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:57.948850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-e41cc4cb-abde-4996-9ad2-b11a0267d317 req-c83a992e-3fc9-4d43-99e5-3ab3e8ff9913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:57.951622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:51:57.951622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:51:57.962711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-e41cc4cb-abde-4996-9ad2-b11a0267d317 req-c83a992e-3fc9-4d43-99e5-3ab3e8ff9913 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:57.966096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-e41cc4cb-abde-4996-9ad2-b11a0267d317 req-c83a992e-3fc9-4d43-99e5-3ab3e8ff9913 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:57.994172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-e41cc4cb-abde-4996-9ad2-b11a0267d317 req-c83a992e-3fc9-4d43-99e5-3ab3e8ff9913 service nova] Creating event network-changed:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:51:58.007826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-e41cc4cb-abde-4996-9ad2-b11a0267d317 req-c83a992e-3fc9-4d43-99e5-3ab3e8ff9913 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063733 Jan 27 16:51:58.010579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 331/643] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:51:58.070235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:58.083980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-db511c87-3fb5-4787-addc-1d0ab351e4bd tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.318261 Jan 27 16:51:58.085784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 313/644] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:57 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:51:58.805840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:58.806898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:58.822481 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:58.824790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:58.825597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:58.828253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.103451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:59.103981 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:59.120063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.120591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.121385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.126164 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.129721 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:59.141763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:59.144492 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:59.147209 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c8db12d6-d394-4218-bf73-43dfb712a91e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1722 microversion: 2.20 time: 0.348279 Jan 27 16:51:59.148334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 332/645] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:58 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:51:59.169863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db7151f2-172b-4a04-8de5-2b80eba04acb"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:59.175137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:59.189729 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.190375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.191292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.191843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.340106 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:51:59.349167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b0b715fc-0ff9-4183-8dce-11dea214a380 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.250084 Jan 27 16:51:59.349858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 314/646] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:51:59 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:51:59.712749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6e417314-73cb-4b18-a72d-405951e13260 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.547722 Jan 27 16:51:59.714719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 333/647] 10.222.0.48 () {62 vars in 1363 bytes} [Thu Jan 27 16:51:59 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments => generated 188 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:51:59.857732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:51:59.858293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:51:59.865472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.866131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.866925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:51:59.867356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:51:59.983498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8aa92bcc-dd50-44f4-a9a7-f5dee6749923 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action" status: 202 len: 0 microversion: 2.20 time: 0.129419 Jan 27 16:51:59.984745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 315/648] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:51:59 2022] POST /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:51:59.996418 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:51:59.997717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:00.008548 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:00.009304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:00.010445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:00.011206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:00.229728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:00.241345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:00.245854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:00.247054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25623204-7175-47e8-8f75-00e1dd5109d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1748 microversion: 2.20 time: 0.255547 Jan 27 16:52:00.248376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 334/649] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:51:59 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1748 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:00.367023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:00.368030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:00.381431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:00.381906 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:00.383071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:00.383796 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:00.575456 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:00.592020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e52cc00b-8c6b-437b-9ce2-42f5a7a06b15 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.228850 Jan 27 16:52:00.592805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 316/650] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:00 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:01.270023 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:01.271537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:01.279887 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:01.280559 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:01.281657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:01.282246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:01.633068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:01.633863 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:01.648250 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:01.649107 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:01.650109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:01.650771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:01.678867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:01.691853 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:01.694803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:01.696037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-de42e6b6-b873-41ef-9fb2-c9685b09ead1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1748 microversion: 2.20 time: 0.434213 Jan 27 16:52:01.696601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 335/651] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:01 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1748 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:01.998731 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:02.010478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f059b464-d88b-4ffd-872e-5a9d917ad098 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.398551 Jan 27 16:52:02.014397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 317/652] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:01 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:02.717825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:02.719214 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:02.730584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:02.731751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:02.733009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:02.733973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:03.034506 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:03.035968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:03.044757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:03.045488 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:03.046636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:03.047249 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:03.119862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:03.130573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:03.132386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:03.136575 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-650f3fc0-4971-4fdc-884f-f70e4aa01f26 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1748 microversion: 2.20 time: 0.423935 Jan 27 16:52:03.140962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 336/653] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:02 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1748 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:03.490058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:03.502671 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-25dc2cf0-cc5d-4726-a4f9-31658a61f9db tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.472331 Jan 27 16:52:03.503255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 318/654] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:03 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:04.155470 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:04.157206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:04.165871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:04.168142 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:04.169168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:04.171434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:04.448010 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:04.457158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:04.459686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:04.461093 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-bcd9ef11-dbf8-4c1c-8258-3032b2e13c1d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1750 microversion: 2.20 time: 0.309244 Jan 27 16:52:04.473033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 337/655] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:04 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1750 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:04.521645 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:04.522843 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:04.535194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:04.535922 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:04.536878 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:04.537474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:04.714534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:04.724807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0872d885-0d16-4379-9147-afb7717ff016 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.207647 Jan 27 16:52:04.725595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 319/656] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:04 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:05.480089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:05.480906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:05.488885 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:05.489342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:05.490138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:05.490570 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:05.744703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:05.748244 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:05.822757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:05.825041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:05.827385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:05.827859 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:05.878675 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:05.910925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:05.918653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:05.922191 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f5905946-890e-43b1-962d-eb4c5a5b8091 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.443981 Jan 27 16:52:05.924473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 338/657] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:05 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:06.070423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:06.086910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a908cd68-effc-47fa-bee1-faff514495ce tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.347345 Jan 27 16:52:06.088305 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 320/658] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:05 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:06.942011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:06.943331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:06.958776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:06.959303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:06.960311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:06.961045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:07.107200 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:07.107776 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:07.116008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:07.116452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:07.117428 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:07.118020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:07.231284 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:07.241555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:07.249990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:07.251428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b6fb6b32-2e73-4c52-8a5b-d9bb2fa50da6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.313915 Jan 27 16:52:07.253084 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 339/659] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:06 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:07.329757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:07.338395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-093d188d-dd31-49f6-84bd-95f70ef887bc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.237904 Jan 27 16:52:07.338946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 321/660] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:07 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:08.271878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:08.273057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:08.280995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:08.281565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:08.282472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:08.283014 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:08.359325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:08.360760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:08.368126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:08.368909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:08.369880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:08.370518 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:08.599696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:08.613593 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:08.615657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:08.618183 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-80340e99-c134-4f42-8b02-993912160898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.351652 Jan 27 16:52:08.629520 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 340/661] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:08 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:08.697213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:08.709056 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-eef103dd-1784-4b64-a0bf-c0564d5d25b2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1567 microversion: 2.1 time: 0.353356 Jan 27 16:52:08.709909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 322/662] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:08 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1567 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:09.648552 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:09.649572 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:09.677395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:09.678077 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:09.679385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:09.681043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:09.729175 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:09.730260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:09.771143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:09.771931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:09.773243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:09.773980 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.405451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:10.415665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1e125b14-d430-48af-ba36-72c134c4025a tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1547 microversion: 2.1 time: 0.692717 Jan 27 16:52:10.420357 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 323/663] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:09 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1547 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:10.423734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:10.433651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:10.441687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:10.443281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e0d1c577-5769-471f-853f-642f75b254aa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.810448 Jan 27 16:52:10.444217 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:10.445091 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:10.446969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 341/664] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:09 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:10.454220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.454891 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.456455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.457086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.794261 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] HTTP exception thrown: Cannot 'detach_volume' instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 while it is in vm_state rescued Jan 27 16:52:10.795757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Returning 409 to user: Cannot 'detach_volume' instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 while it is in vm_state rescued {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:52:10.796777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ff7800db-744e-43ed-8828-3c32317e369e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments/50299ec3-be33-4043-91fa-faf10a5c5cf1" status: 409 len: 152 microversion: 2.1 time: 0.361840 Jan 27 16:52:10.797528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 324/665] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:52:10 2022] DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments/50299ec3-be33-4043-91fa-faf10a5c5cf1 => generated 152 bytes in 363 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 27 16:52:10.807208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:10.808497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:10.817469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.817903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.818895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.819496 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.946003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-657a23a3-2e83-4c89-b871-7f6f5263439d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action" status: 202 len: 0 microversion: 2.1 time: 0.143371 Jan 27 16:52:10.947052 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 342/666] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:52:10 2022] POST /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:52:10.960848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:10.962399 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:10.989403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.990564 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:10.992968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:10.994294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:11.469966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:11.472429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:11.491876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:11.495541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:11.496732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:11.497349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:11.630288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:11.655914 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5bfbc262-04fa-404b-b98c-b01a23c19195 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.699771 Jan 27 16:52:11.658998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 325/667] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:10 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:11.813899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:11.824225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:11.827411 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:11.831447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9d2f8518-f031-4855-bf17-a03f6e2a23ac tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.368805 Jan 27 16:52:11.835457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 343/668] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:11 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:12.321253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:12.322455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:12.358008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:12.358586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:12.371960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:12.373838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:12.698296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:12.700342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:12.706645 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lazy-loading 'services' on Instance uuid 58a6eecd-4759-477d-8484-e510a7638b40 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:52:12.750702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:12.751166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:12.760145 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:12.763515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:13.013023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2ea2425a-399f-4c78-afa7-df82de60f29d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40/os-volume_attachments/80c489d7-af75-45fa-a760-5f7704a99fec" status: 202 len: 0 microversion: 2.1 time: 0.695951 Jan 27 16:52:13.029516 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 326/669] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:52:12 2022] DELETE /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40/os-volume_attachments/80c489d7-af75-45fa-a760-5f7704a99fec => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:52:13.072963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:13.075227 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:13.094104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:13.094893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:13.099788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:13.100596 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:13.617720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:13.629683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a33745e8-1790-4cfc-b580-b15974b2421c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.954571 Jan 27 16:52:13.644019 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 344/670] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:12 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:13.795789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:13.813904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:13.816370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:13.829594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-74541c3f-c97c-4a6e-ac17-7f489a82c7eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.796580 Jan 27 16:52:13.834326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 327/671] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:13 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:14.647215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:14.647998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:14.666025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:14.666838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:14.677846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:14.687588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:14.862393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:14.864746 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:14.881702 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:14.886137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:14.891821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:14.892812 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:15.665475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:15.675778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:15.680595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:15.684982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1b5f4f6c-7e2d-4e10-bec2-f57689feaab0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.835656 Jan 27 16:52:15.698297 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 328/672] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:14 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:15.707231 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:15.719753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8cc58703-6bd2-4de5-9e4c-7036370f1fd8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 1.077213 Jan 27 16:52:15.720382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 345/673] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:14 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:16.705650 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:16.706475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:16.713162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:16.713974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:16.715021 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:16.715594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:16.737860 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:16.739255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:16.747008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:16.747783 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:16.749189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:16.749790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:17.032156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:17.041217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-046a35b4-1772-4e71-8b3c-127dec08cbd6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.307732 Jan 27 16:52:17.041987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 346/674] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:16 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:17.043689 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:17.061836 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:17.063665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:17.065941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-40369666-2fdf-462b-9694-3c3bf67d8ea7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.364568 Jan 27 16:52:17.066676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 329/675] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:16 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:18.062184 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:18.063544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:18.085657 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:18.087052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:18.095042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:18.099720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:18.100452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:18.100703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:18.101722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:18.102825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:18.103286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:18.104076 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:18.507123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:18.526268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8a52f0a5-ee90-4cb2-884d-ed2fb2af798c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.467672 Jan 27 16:52:18.531635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 347/676] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:18 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:18.564975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:18.633256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:18.636295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:18.639787 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2b059629-f19f-4058-829a-e6de7a9ac98b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.558065 Jan 27 16:52:18.643752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 330/677] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:18 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:19.548262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:19.549332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:19.558642 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.560806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.563054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.563680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.662770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:19.664821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:19.677288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.683331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.684632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.685351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.826833 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:19.836308 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6b78e782-76ef-4e0e-aa7b-560087a912fe tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.291930 Jan 27 16:52:19.840898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 348/678] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:19 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:19.911302 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:19.912083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:19.922634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.925206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.927396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:19.930349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:19.984829 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:52:20.021470 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:20.048032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:20.053797 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:20.056253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-41df8d36-4c87-4b5d-b080-7d98004213d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.397380 Jan 27 16:52:20.065109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 331/679] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:19 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:20.146713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-16a5106e-a7b4-4d74-bbc2-f5a4dbc65414 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "DELETE /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 204 len: 0 microversion: 2.1 time: 0.238723 Jan 27 16:52:20.148897 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 349/680] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:52:19 2022] DELETE /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:52:20.198059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:20.202133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:20.218998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:20.220176 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:20.221711 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:20.222367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:20.457066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:20.476000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9c53af7c-07e8-4429-9479-aa3fa2cf09ba tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1513 microversion: 2.1 time: 0.292819 Jan 27 16:52:20.489388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 332/681] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:20 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:20.858120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:20.859862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:20.870156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:20.870894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:20.871771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:20.872713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:21.087294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:21.088621 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:21.104652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:21.105101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:21.105905 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:21.106334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:21.303298 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:21.316143 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d3b11879-6684-4ba0-a05b-1823db695510 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1555 microversion: 2.1 time: 0.461816 Jan 27 16:52:21.317133 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 350/682] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:20 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1555 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:21.405463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:21.414488 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:21.417780 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:21.419172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2cfa0d6a-0a2a-4da0-aab9-6996bd20f983 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.340514 Jan 27 16:52:21.420109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 333/683] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:21 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:21.493976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:21.495742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:21.506283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:21.506673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:21.507400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:21.513495 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:21.785343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:21.796641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-799655bc-21b6-4925-81e3-2e3f15388bf6 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1513 microversion: 2.1 time: 0.306332 Jan 27 16:52:21.807945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 351/684] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:21 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1513 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:22.334084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:22.335528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:22.343279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.343783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.344570 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.345063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.438181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:22.438827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:22.448981 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.449435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.450220 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.454590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.499798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:22.518793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-58e51aca-cda3-410a-81e2-6a086a0b6b33 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1561 microversion: 2.1 time: 0.189017 Jan 27 16:52:22.532339 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 334/685] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:22 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:22.640477 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:22.651395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:22.653206 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:22.660239 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.661061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.662590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:22.664848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:22.666069 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b545ed6c-167e-4744-993e-83324a667e3c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.232316 Jan 27 16:52:22.671633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 352/686] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:22 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:22.684760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.685352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.796043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lazy-loading 'services' on Instance uuid 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:52:22.813628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:22.814970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:22.829129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.830014 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.830858 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.831494 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.893481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fa4fb795-a889-42d5-8699-b1c13ed316b1 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments/50299ec3-be33-4043-91fa-faf10a5c5cf1" status: 202 len: 0 microversion: 2.1 time: 0.256165 Jan 27 16:52:22.895149 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 335/687] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:52:22 2022] DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments/50299ec3-be33-4043-91fa-faf10a5c5cf1 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:52:22.904270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:22.905819 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:22.920848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.923325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.927783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:22.928441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:22.986293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-28175dc1-d4e8-47d1-8cab-37a32f42b967 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086651 Jan 27 16:52:22.986979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 336/688] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:52:22 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:23.025615 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:23.034881 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-be0e2fb4-8efb-4643-8457-23ad17fef05b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1513 microversion: 2.1 time: 0.224980 Jan 27 16:52:23.035796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 353/689] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:22 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:23.688171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:23.689699 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:23.704212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:23.705202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:23.707015 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:23.707661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:23.911758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:23.914464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-ae18c3c4-aba4-4fb0-9014-751cec0f068d req-648d7733-68c2-4343-adec-77c3c9fcad4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6eecd-4759-477d-8484-e510a7638b40", "name": "network-vif-deleted", "tag": "404e12cf-c62c-4c23-b50c-848e2b404dec"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:23.918995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:23.918995 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:23.931467 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:23.931660 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-ae18c3c4-aba4-4fb0-9014-751cec0f068d req-648d7733-68c2-4343-adec-77c3c9fcad4f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:23.932092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-ae18c3c4-aba4-4fb0-9014-751cec0f068d req-648d7733-68c2-4343-adec-77c3c9fcad4f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:23.933110 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:23.934329 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-718e1ff7-169d-4857-a443-7e558fe4ac45 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.249769 Jan 27 16:52:23.938253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 337/690] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:23 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:23.949462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-ae18c3c4-aba4-4fb0-9014-751cec0f068d req-648d7733-68c2-4343-adec-77c3c9fcad4f service nova] Creating event network-vif-deleted:404e12cf-c62c-4c23-b50c-848e2b404dec for instance 58a6eecd-4759-477d-8484-e510a7638b40 on hv-cinder-81883 Jan 27 16:52:23.959957 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-ae18c3c4-aba4-4fb0-9014-751cec0f068d req-648d7733-68c2-4343-adec-77c3c9fcad4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051118 Jan 27 16:52:23.961228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 354/691] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:52:23.997987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:23.998936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:24.016175 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.017480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.018722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.019920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.058009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d5a87c24-5268-46f2-8614-141ab52bd6d0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063412 Jan 27 16:52:24.061566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:24.062294 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:24.063737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 338/692] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:52:23 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:52:24.074928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.075438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.076383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.076997 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.122925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.123324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.123921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lazy-loading 'fault' on Instance uuid 58a6eecd-4759-477d-8484-e510a7638b40 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:52:24.187443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:24.196412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-eb5def98-d275-4f00-bc9f-3529b310e8df tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 200 len: 1308 microversion: 2.1 time: 0.145570 Jan 27 16:52:24.197286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 355/693] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:24 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:24.953469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:24.955029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:24.961984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.962432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:24.963265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:24.963734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:25.106090 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:25.115345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:25.116829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:25.118171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a017f4e2-b842-4f41-9234-dd5b4dfb8fcb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.168378 Jan 27 16:52:25.118878 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 339/694] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:24 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:25.215803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:25.216430 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: 58a6eecd-4759-477d-8484-e510a7638b40] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:25.223476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:25.224323 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:25.225283 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:25.225719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:25.240443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] HTTP exception thrown: Instance 58a6eecd-4759-477d-8484-e510a7638b40 could not be found. Jan 27 16:52:25.241057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Returning 404 to user: Instance 58a6eecd-4759-477d-8484-e510a7638b40 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:52:25.241888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3c3a0c6d-b4e8-4f2f-97bf-4d4f90f744d2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40" status: 404 len: 111 microversion: 2.1 time: 0.029957 Jan 27 16:52:25.242440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 356/695] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:25 2022] GET /compute/v2.1/servers/58a6eecd-4759-477d-8484-e510a7638b40 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:26.136392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:26.137002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:26.143622 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.144542 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.145348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.145772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.296949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:26.308626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:26.310121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:26.311670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a16cd203-47b6-4964-9177-453af136753b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.178682 Jan 27 16:52:26.312410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 340/696] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:26 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:26.507443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:26.508088 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:26.514654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.515208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.516073 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.516573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.547266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:52:26.660558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c89185d2-56f1-4dbb-87e4-fee9f810fecc tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 204 len: 0 microversion: 2.1 time: 0.154066 Jan 27 16:52:26.661677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 357/697] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:52:26 2022] DELETE /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:52:26.673204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:26.674336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:26.681142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.681591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.682401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:26.682845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:26.826686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:26.834637 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9a3893d8-b8b5-419d-a1c6-e42e919d90d6 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.166453 Jan 27 16:52:26.835597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 341/698] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:26 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:27.300320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'create', calling method: .version_select at 0x7f0cf0621820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-167211131"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:27.314569 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for project fe08ade68b284511b92c42fba70f29d3. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:52:27.318329 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for user f949c79110dd4ceaa532c18230e00a38 and project fe08ade68b284511b92c42fba70f29d3. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:52:27.329136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:27.330292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:27.336040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.336477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:27.337352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.337777 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:27.467758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:27.476559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:27.478032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:27.479184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-61c5a8cb-9414-4623-bf8f-d4d7f9bd1bb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.153626 Jan 27 16:52:27.479758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 342/699] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:27 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:27.483312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for project fe08ade68b284511b92c42fba70f29d3. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:52:27.488482 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for user f949c79110dd4ceaa532c18230e00a38 and project fe08ade68b284511b92c42fba70f29d3. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:52:27.500831 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8c7eb869-11c9-4f4e-8e36-3fcab0f7a47f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.205033 Jan 27 16:52:27.501671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 358/700] 10.222.0.48 () {60 vars in 1157 bytes} [Thu Jan 27 16:52:27 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:27.549969 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2028267979", "imageRef": "75156cd2-339a-44d2-aa1b-ee40c0113c06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-167211131", "networks": [{"uuid": "0cf8540c-4553-4409-baa3-685ce5fef788"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:27.598046 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] validate_networks() for [('0cf8540c-4553-4409-baa3-685ce5fef788', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:52:27.853084 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:27.853802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:27.859489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.859962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:27.860803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.861564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:27.982338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:52:27.982760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:52:27.983441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:52:27.983875 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:52:27.984290 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:52:27.993854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.994302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:27.995108 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:27.995545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:28.012326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for project fe08ade68b284511b92c42fba70f29d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:52:28.016245 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Getting quotas for user f949c79110dd4ceaa532c18230e00a38 and project fe08ade68b284511b92c42fba70f29d3. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:52:28.028740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:52:28.030975 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75156cd2-339a-44d2-aa1b-ee40c0113c06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:52:28.039081 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:28.046609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9d9ab77b-a179-4289-be5e-97229bfb562e tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.197620 Jan 27 16:52:28.047262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 359/701] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:27 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:28.076063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e623a171-eb59-4914-b0ac-1fc82103405d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530763 Jan 27 16:52:28.076693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 343/702] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:52:28.087179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-049e486d-82a2-45b6-a148-bcdbc7aec545 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:28.087808 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-049e486d-82a2-45b6-a148-bcdbc7aec545 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:28.140459 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-049e486d-82a2-45b6-a148-bcdbc7aec545 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:28.148412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-049e486d-82a2-45b6-a148-bcdbc7aec545 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1258 microversion: 2.1 time: 0.064923 Jan 27 16:52:28.148977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 360/703] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:28 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:28.497833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:28.498576 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:28.506262 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:28.506718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:28.507505 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:28.507962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:28.650864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:28.661183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:28.663052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:28.664240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-11ca85fe-0eef-4fee-abe6-89c498ed7b9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.170697 Jan 27 16:52:28.664795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 344/704] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:28 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:29.063179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:29.064365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:29.071422 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.072128 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:29.072906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.074218 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:29.164945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:29.165904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:29.171911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.172672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:29.174406 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.175062 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:29.229711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:29.239827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e6d84f97-03ca-4111-952e-096224fbe660 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.180235 Jan 27 16:52:29.244324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 361/705] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:29 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:29.249923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:29.258579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6714773a-0c56-4d89-a85d-2b22a5e15986 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1328 microversion: 2.1 time: 0.097131 Jan 27 16:52:29.259225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 345/706] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:29 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1328 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:29.689525 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:29.690460 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:29.712040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.712933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:29.714215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:29.715102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:30.057469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:30.069167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:30.072522 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:30.076793 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7c44bfbf-5516-454e-b03a-26da7c0a1f39 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.393435 Jan 27 16:52:30.080500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 362/707] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:29 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:30.260589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:30.262550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:30.277179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:30.278472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:30.285230 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:30.286191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:30.287890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:30.288568 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:30.290225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:30.294969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:30.295981 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:30.297126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:30.633225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:30.650523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b0e8da0e-0466-4886-9b44-18989a9176bb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.369993 Jan 27 16:52:30.652086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 363/708] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:30 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:30.655474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:30.663408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-313845a9-7e9c-44fc-abdb-efb587728b18 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.406638 Jan 27 16:52:30.674171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 346/709] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:30 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:31.034969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-5018eb38-4b49-420b-bb81-e2e64588fd44 req-414c39b4-1f95-4813-9db8-417788bb50c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:31.036562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:31.036562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:31.051228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5018eb38-4b49-420b-bb81-e2e64588fd44 req-414c39b4-1f95-4813-9db8-417788bb50c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.052118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5018eb38-4b49-420b-bb81-e2e64588fd44 req-414c39b4-1f95-4813-9db8-417788bb50c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.068608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-5018eb38-4b49-420b-bb81-e2e64588fd44 req-414c39b4-1f95-4813-9db8-417788bb50c8 service nova] Creating event network-changed:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:52:31.074704 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-5018eb38-4b49-420b-bb81-e2e64588fd44 req-414c39b4-1f95-4813-9db8-417788bb50c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043400 Jan 27 16:52:31.076327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 364/710] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:31.095638 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:31.096252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:31.103558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.104235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.105205 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.105824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.291605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:31.301553 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:31.304821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:31.306187 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-865dbac4-5ed6-469e-bcec-554af3c33117 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.214910 Jan 27 16:52:31.307235 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 347/711] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:31 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:31.669291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:31.669992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:31.677615 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.678065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.678861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.679298 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.686198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:31.687068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:31.696162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.700324 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.702498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:31.703736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:31.884604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:31.892661 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f4bfa2e2-036f-4c34-8686-b07448a0433b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.228438 Jan 27 16:52:31.894158 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 365/712] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:31 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:31.909554 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:31.916912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2829cdee-b4d6-49a5-87b6-d7178d24195c tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.239179 Jan 27 16:52:31.917480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 348/713] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:31 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:32.326105 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:32.327747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:32.333966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.334435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:32.335265 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.335734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:32.487828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:32.502952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:32.504768 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:32.505952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0f14417c-272f-4676-a2d3-03ac0f6f2058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.183536 Jan 27 16:52:32.506507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 366/714] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:32 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:32.909794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:32.910434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:32.916629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.917072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:32.917849 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.918275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:32.936755 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:32.937898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:32.948595 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.949043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:32.949982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:32.950575 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:33.109204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:33.118133 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1000908f-658e-4157-82f0-e2e01cb10f52 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.212128 Jan 27 16:52:33.119258 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 349/715] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:32 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:33.156425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:33.170303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-49065550-55de-4633-a135-316bfd880315 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.237273 Jan 27 16:52:33.171092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 367/716] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:32 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:33.525825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:33.526436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:33.532499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:33.533027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:33.533768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:33.534223 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:33.669558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:33.679180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:33.681561 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:33.683715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3db3d39a-7ba6-42a1-9aef-90a01e8d913d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.161233 Jan 27 16:52:33.684718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 350/717] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:33 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:34.135839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:34.136447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:34.143448 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.144162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.144925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.145352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.188805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:34.190895 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:34.196921 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.197311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.198156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.198491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.365786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:34.374101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0d5e86e3-1dcf-4368-827f-181e98635c55 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.241769 Jan 27 16:52:34.374682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 368/718] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:34 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:34.389910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-2a5c6ab0-4838-455d-8527-3bdfcb2e2acc req-b79d2446-2aa1-4e99-bf0c-565c82660e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "name": "network-vif-plugged", "status": "completed", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:34.391625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:34.391625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:34.402117 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2a5c6ab0-4838-455d-8527-3bdfcb2e2acc req-b79d2446-2aa1-4e99-bf0c-565c82660e82 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.402546 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2a5c6ab0-4838-455d-8527-3bdfcb2e2acc req-b79d2446-2aa1-4e99-bf0c-565c82660e82 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.423771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-2a5c6ab0-4838-455d-8527-3bdfcb2e2acc req-b79d2446-2aa1-4e99-bf0c-565c82660e82 service nova] Creating event network-vif-plugged:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:52:34.433255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-2a5c6ab0-4838-455d-8527-3bdfcb2e2acc req-b79d2446-2aa1-4e99-bf0c-565c82660e82 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046390 Jan 27 16:52:34.434031 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 369/719] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:52:34.434922 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:34.442487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-de2459db-99bd-430d-ae1f-cb2f2d26e1ae tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.257823 Jan 27 16:52:34.446530 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 351/720] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:34 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:34.705886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:34.706486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:34.712555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.713000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.713758 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:34.714188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:34.877126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:34.894620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:34.896427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:34.897753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-727286b5-b91a-4e08-9c9d-96eb39d07e92 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.196731 Jan 27 16:52:34.898318 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 370/721] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:34 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:35.369827 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-964637029", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "networks": [{"uuid": "3ff7763e-e8af-430b-afaa-86998ea27f64"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:35.390307 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:35.390924 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:35.402873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:35.403336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:35.404165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:35.404600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:35.429571 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] validate_networks() for [('3ff7763e-e8af-430b-afaa-86998ea27f64', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:52:35.655360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:35.662931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6bad4e09-85a9-4da1-937f-33591a387ee1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.276428 Jan 27 16:52:35.663862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 371/722] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:35 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:35.675058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:35.675703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:35.681740 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:35.682184 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:35.682993 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:35.683590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.134997 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.151688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b48a27c2-6c20-4a86-9c18-f0d652028818 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.486915 Jan 27 16:52:36.152292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 372/723] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:35 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:36.157694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:36.158473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:36.164558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.164898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.165658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.166090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.178932 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:52:36.179358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:52:36.179848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:52:36.180447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:52:36.180864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:52:36.190083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.190794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.191618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.192049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.209304 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Getting quotas for project 5f4ae6dda115477db147059df89ad002. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:52:36.213481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Getting quotas for user 7f0c0ea1e431437880ed43ef1c9cb1bb and project 5f4ae6dda115477db147059df89ad002. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:52:36.225425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:52:36.228770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:52:36.278055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-598a114d-19ef-42dd-a2b1-86f159a40e09 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911768 Jan 27 16:52:36.283612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 352/724] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:52:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:52:36.295686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-87cf2851-0228-442e-81cd-86397418915a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:36.296500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-87cf2851-0228-442e-81cd-86397418915a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:36.304182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.317928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.319418 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.320628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e2a02704-7155-475e-a2cf-6779116419bd tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.167415 Jan 27 16:52:36.321189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 373/725] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:36 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:36.352479 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-87cf2851-0228-442e-81cd-86397418915a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.360512 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-87cf2851-0228-442e-81cd-86397418915a tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1218 microversion: 2.1 time: 0.073450 Jan 27 16:52:36.363694 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 353/726] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:36 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:36.681485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:36.682750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:36.689886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.690370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.691167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:36.691656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:36.832306 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:36.840486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9bba7c78-d1b3-4e04-9960-423562d8b36c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.162844 Jan 27 16:52:36.841060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 374/727] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:36 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:37.169992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:37.170597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:37.177012 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.177542 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.178246 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.178729 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.314345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:37.321611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3268494f-eb09-4a21-a594-e58ffee493f8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.155309 Jan 27 16:52:37.322183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 354/728] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:37 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:37.339032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:37.339665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:37.345848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.346297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.347086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.347607 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.377439 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:37.378163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:37.384538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.385256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.386258 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.386762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.463843 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:37.472977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2b8f8c53-53e9-473e-bb22-f84a3f72a226 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1222 microversion: 2.1 time: 0.099794 Jan 27 16:52:37.473700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 355/729] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:37 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:37.506050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:37.514560 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:37.516072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:37.519008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b39f66bd-6945-4c33-9e87-8f1ebcedd67e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.183364 Jan 27 16:52:37.519601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 375/730] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:37 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:37.858192 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:37.858825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:37.865974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.866416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:37.867597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:37.867730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.004179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.011625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a4cdb4c0-bf5e-4a0d-a581-39bb362e9bbf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.157616 Jan 27 16:52:38.012204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 356/731] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:37 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:38.338694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:38.339312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:38.346710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.347166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.347983 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.348427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.483650 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.489805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:38.490408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:38.491195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-25e7db95-8d0c-451e-a579-e18d4029f310 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.156156 Jan 27 16:52:38.500520 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 376/732] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:38 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:38.500710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.500710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.500710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.500710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.538340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:38.538960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:38.545493 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.545989 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.546728 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:38.547167 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:38.560941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.569566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7b656d1d-43f0-4f38-af4c-6d129e141b67 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1222 microversion: 2.1 time: 0.083241 Jan 27 16:52:38.570142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 357/733] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:38 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:38.675968 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.684119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.685608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:38.686775 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0d49d336-bc5f-4fbe-99c2-fe16d3003ffc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.152216 Jan 27 16:52:38.687338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 377/734] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:38 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:39.028394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:39.029041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:39.034954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.035447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.036257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.036696 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.169279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.176963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-65d9ac12-abdd-4586-97a1-d019ea1b4927 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.152278 Jan 27 16:52:39.177740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 358/735] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:39 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:39.513169 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:39.516850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:39.529437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.530643 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.531885 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.532479 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.586013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:39.586825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:39.602174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.603347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.605907 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.606915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.690426 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.697961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5ae1bd16-b8ee-438a-88cf-96c488a866e0 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1288 microversion: 2.1 time: 0.115767 Jan 27 16:52:39.698776 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 359/736] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:39 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1288 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:39.705296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:39.705981 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:39.711695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.712152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.712923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:39.713580 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:39.731538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.738887 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-68267eba-2e7a-4940-a9e7-561c384d833b tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1508 microversion: 2.1 time: 0.233606 Jan 27 16:52:39.739457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 378/737] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:39 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:39.839639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.848373 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.849888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:39.851045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-65add62f-67aa-4f0a-8a79-15216a0dbb01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.149967 Jan 27 16:52:39.851612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 360/738] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:39 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:52:40.193473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:40.194000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:40.199712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.200160 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.201013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.201461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.414496 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:40.421765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cc8aa67c-5fec-4887-864a-8e13e287fd5b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.231972 Jan 27 16:52:40.422961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 379/739] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:40 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:40.682772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-33480659-c24a-4308-8b2f-ffd7a1b5eed4 req-45d7929d-a587-4b31-b0eb-fca8fe9317b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5490cbd-3604-4065-b528-a305f9f211ce", "name": "network-vif-deleted", "tag": "8e60561d-e86c-4bcf-b188-6be71158ac4e"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:40.684375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:40.684375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:52:40.691857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-33480659-c24a-4308-8b2f-ffd7a1b5eed4 req-45d7929d-a587-4b31-b0eb-fca8fe9317b5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.692559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-33480659-c24a-4308-8b2f-ffd7a1b5eed4 req-45d7929d-a587-4b31-b0eb-fca8fe9317b5 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.705242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-33480659-c24a-4308-8b2f-ffd7a1b5eed4 req-45d7929d-a587-4b31-b0eb-fca8fe9317b5 service nova] Creating event network-vif-deleted:8e60561d-e86c-4bcf-b188-6be71158ac4e for instance b5490cbd-3604-4065-b528-a305f9f211ce on hv-cinder-81883 Jan 27 16:52:40.712089 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-33480659-c24a-4308-8b2f-ffd7a1b5eed4 req-45d7929d-a587-4b31-b0eb-fca8fe9317b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032313 Jan 27 16:52:40.713029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 361/740] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:52:40.716551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:40.717176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:40.732412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.732871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.735409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.735979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.757869 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:40.759763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:40.770805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.772325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.773121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.773551 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.805925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.806362 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.806800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lazy-loading 'fault' on Instance uuid b5490cbd-3604-4065-b528-a305f9f211ce {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:52:40.872839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:40.881402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-60b099f1-2211-40ee-a592-2060ca2579ec tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 200 len: 1312 microversion: 2.1 time: 0.128417 Jan 27 16:52:40.881988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 362/741] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:40 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:40.886440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:40.887047 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:40.893044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.893751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:40.894531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:40.894966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.035443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:41.044138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c329a7aa-1b99-49f7-8c8f-da42216c28da tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.333105 Jan 27 16:52:41.054160 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 380/742] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:40 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:41.138910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:41.150540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:41.152024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:41.153198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-060366c4-6408-4f63-a5c9-6eeef6674081 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1806 microversion: 2.20 time: 0.270164 Jan 27 16:52:41.153971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 363/743] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:40 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1806 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:41.439394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-61982170-fc2c-4e2d-bf46-d81541b46e63 req-fedb1670-1402-40d3-a02e-e1e3317333b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b36243-1023-4580-b4d7-75cdc8f89235", "tag": "ff94a552-d3cc-4af3-b145-4bd0250f04cb"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:41.441899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:41.441899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:41.442394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:41.443159 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:41.451014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.451473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.452381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.452824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.452949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-61982170-fc2c-4e2d-bf46-d81541b46e63 req-fedb1670-1402-40d3-a02e-e1e3317333b7 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.453259 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-61982170-fc2c-4e2d-bf46-d81541b46e63 req-fedb1670-1402-40d3-a02e-e1e3317333b7 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.467350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-61982170-fc2c-4e2d-bf46-d81541b46e63 req-fedb1670-1402-40d3-a02e-e1e3317333b7 service nova] Creating event network-changed:ff94a552-d3cc-4af3-b145-4bd0250f04cb for instance e6b36243-1023-4580-b4d7-75cdc8f89235 on hv-cinder-81883 Jan 27 16:52:41.474549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-61982170-fc2c-4e2d-bf46-d81541b46e63 req-fedb1670-1402-40d3-a02e-e1e3317333b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039455 Jan 27 16:52:41.479179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 381/744] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:41.696499 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:41.704678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2080e8be-bf75-4b7c-bb10-ceabc50c5e30 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.267142 Jan 27 16:52:41.705338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 364/745] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:41 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:41.899890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:41.901469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: b5490cbd-3604-4065-b528-a305f9f211ce] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:41.908686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.909138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.909917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.910354 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.924596 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] HTTP exception thrown: Instance b5490cbd-3604-4065-b528-a305f9f211ce could not be found. Jan 27 16:52:41.925479 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Returning 404 to user: Instance b5490cbd-3604-4065-b528-a305f9f211ce could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:52:41.926406 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-11e4aa79-ef46-40dd-b86b-40a953bf6d60 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce" status: 404 len: 111 microversion: 2.1 time: 0.031465 Jan 27 16:52:41.927672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 382/746] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:41 2022] GET /compute/v2.1/servers/b5490cbd-3604-4065-b528-a305f9f211ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:41.938535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:41.939093 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:41.946224 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.946626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.947685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:41.948315 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:41.974886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:52:42.050386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7796d7b6-12e8-41ed-9095-c99b68dcc1a2 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 204 len: 0 microversion: 2.1 time: 0.115289 Jan 27 16:52:42.051083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 365/747] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:52:41 2022] DELETE /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:52:42.058988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:42.059622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:42.061822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:42.062649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:42.065890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.066577 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.067360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.067851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.069100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.069639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.070420 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.070996 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.362289 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.370252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.373784 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d7fd2a76-c499-4069-90c0-8a55ab8bf4e0 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.317787 Jan 27 16:52:42.380607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e5221fa1-81f9-454a-a093-a01d50254c79 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.322950 Jan 27 16:52:42.381327 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 366/748] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:42 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:42.384432 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 383/749] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:42 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:42.386749 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:42.387423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:42.395165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.396577 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.397930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.399789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.642147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.650718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.652240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.653402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3aa87a23-afca-4266-9f30-6b7bd509e4df tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1793 microversion: 2.20 time: 0.270677 Jan 27 16:52:42.653961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 367/750] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:52:42 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1793 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:52:42.722296 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:42.722849 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:42.728711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.729165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.729944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:42.730381 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:42.860863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:42.868113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b6333388-834b-45f0-904f-8dc9daa47780 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.150312 Jan 27 16:52:42.868896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 384/751] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:42 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:43.390579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:43.392340 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:43.397828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:43.398473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:43.399152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.399676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:43.400451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.400879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:43.404677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.405130 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:43.405905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.406340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:43.593337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:43.597405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:43.601151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-377bae5c-7cd1-4feb-aa9a-ca691984e9e3 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.214264 Jan 27 16:52:43.601727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 368/752] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:43 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:43.604605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c73e53e6-4fbf-4681-85b3-67ce5105a2c7 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.210391 Jan 27 16:52:43.605162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 385/753] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:43 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:43.884127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:43.884737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:43.890511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.891041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:43.891747 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:43.892189 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.020307 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:44.027355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dd0ce8da-e1a6-4ed2-bc9c-93ecfe2e2ecb tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.146838 Jan 27 16:52:44.027943 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 369/754] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:43 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:44.527982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-07aac272-a8de-432f-929f-5bb7e042459d req-c2f13b18-17a3-4a25-b166-a6f981d1100d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "name": "network-vif-plugged", "status": "completed", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:44.530683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:44.530683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:44.540390 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-07aac272-a8de-432f-929f-5bb7e042459d req-c2f13b18-17a3-4a25-b166-a6f981d1100d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:44.540935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-07aac272-a8de-432f-929f-5bb7e042459d req-c2f13b18-17a3-4a25-b166-a6f981d1100d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.552425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-07aac272-a8de-432f-929f-5bb7e042459d req-c2f13b18-17a3-4a25-b166-a6f981d1100d service nova] Creating event network-vif-plugged:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:52:44.557407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-07aac272-a8de-432f-929f-5bb7e042459d req-c2f13b18-17a3-4a25-b166-a6f981d1100d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033257 Jan 27 16:52:44.558000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 386/755] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:52:44.619579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:44.620797 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:44.622119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:44.622914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:44.629952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:44.630489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.630629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:44.631177 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.631766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:44.632369 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.632874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:44.633998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:44.882952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:44.889880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:44.891877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-05c12ffb-43d7-4b2a-9461-04a2d47e0007 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.274038 Jan 27 16:52:44.896875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 387/756] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:44 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:44.900890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e6da0e1f-775c-4116-aca7-40d055a2a4ca tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.286063 Jan 27 16:52:44.910033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 370/757] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:44 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:45.044706 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:45.045365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:45.051277 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.051759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:45.052537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.052976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:45.179236 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:45.186413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3230504a-0fc2-4879-8646-1d58dc58fced tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.145381 Jan 27 16:52:45.186974 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 388/758] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:45 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:45.909535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:45.910033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:45.916351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.916801 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:45.917573 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.917683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:45.918110 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:45.918275 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:45.925045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.925511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:45.926312 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:45.926739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:46.112762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:46.117215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:46.120033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ece19eff-59e5-412a-9633-b98c6539e4ab tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.214964 Jan 27 16:52:46.120608 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 371/759] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:45 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:46.124756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2150250d-5f09-434b-80bb-c6f968801944 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.210626 Jan 27 16:52:46.125393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 389/760] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:45 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:46.201925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:46.202450 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:46.208183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:46.208621 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:46.209377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:46.209801 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:46.345912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:46.355973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ee2f222b-918c-429a-b62d-ed07436aa140 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1358 microversion: 2.1 time: 0.157067 Jan 27 16:52:46.364006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 372/761] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:46 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:46.571659 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-f8784a07-70cb-4552-9dc5-26d184bb6a10 req-3c198658-dc53-4efc-893f-4ad04635b3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b36243-1023-4580-b4d7-75cdc8f89235", "name": "network-vif-plugged", "status": "completed", "tag": "ff94a552-d3cc-4af3-b145-4bd0250f04cb"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:46.573259 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:46.573259 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:46.580619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-f8784a07-70cb-4552-9dc5-26d184bb6a10 req-3c198658-dc53-4efc-893f-4ad04635b3c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:46.581059 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-f8784a07-70cb-4552-9dc5-26d184bb6a10 req-3c198658-dc53-4efc-893f-4ad04635b3c8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:46.591309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-f8784a07-70cb-4552-9dc5-26d184bb6a10 req-3c198658-dc53-4efc-893f-4ad04635b3c8 service nova] Creating event network-vif-plugged:ff94a552-d3cc-4af3-b145-4bd0250f04cb for instance e6b36243-1023-4580-b4d7-75cdc8f89235 on hv-cinder-81883 Jan 27 16:52:46.596788 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-f8784a07-70cb-4552-9dc5-26d184bb6a10 req-3c198658-dc53-4efc-893f-4ad04635b3c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028944 Jan 27 16:52:46.597399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 390/762] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:47.136958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.137486 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:47.142062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.142762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:47.144732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.145183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.145962 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.146392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.148876 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.149327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.150101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.150537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.335448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:47.340148 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:47.343054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9d993cdc-b6ec-4c1b-821e-2a283bb0995c tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1318 microversion: 2.1 time: 0.209776 Jan 27 16:52:47.343768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 373/763] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:47.348514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-19d2b501-66f3-4457-92e0-659285576ef8 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.210974 Jan 27 16:52:47.349079 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 391/764] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:47.373084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.373697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:47.379452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.380050 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.380704 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.381136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.507945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:47.515165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1bb709a5-6e1d-4a01-abe4-c17e1c7527cc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1549 microversion: 2.1 time: 0.145574 Jan 27 16:52:47.516265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 374/765] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:47.531979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.532565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:47.538317 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.538768 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.539542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.540009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.668515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:47.676281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e2d74661-dc64-4141-9cde-58d42c464300 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1549 microversion: 2.1 time: 0.148578 Jan 27 16:52:47.676848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 392/766] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:47.692160 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.695559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:47.695559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:52:47.696668 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:47.697411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Searching by: {'deleted': False, 'project_id': 'fe08ade68b284511b92c42fba70f29d3'} {{(pid=127795) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 27 16:52:47.704568 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.705007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.705818 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.706253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.791834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.multi_cell_list [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127795) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 27 16:52:47.882256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5b3a904a-1e5f-45d6-9264-5a104c2b3f4f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.193716 Jan 27 16:52:47.882830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 375/767] 10.222.0.48 () {58 vars in 1124 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:47.892870 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:47.893746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:47.899465 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.899945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:47.900714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:47.901144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.026840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:48.034872 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e0d47195-7d42-40d6-bd44-a47c01ea18d6 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1549 microversion: 2.1 time: 0.145827 Jan 27 16:52:48.035435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 393/768] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:47 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:48.365364 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:48.366387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:48.366899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:48.367144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:48.372591 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.373039 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.373822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.374252 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.374833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.375679 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.376620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.377061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.769444 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:48.776869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-85e755fe-1494-4810-a2a9-8fdfcc0f7a75 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1521 microversion: 2.1 time: 0.415521 Jan 27 16:52:48.777445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 394/769] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:48 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:48.788734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:48.797401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-31204822-572c-4848-8416-aca0f59dc27d tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1507 microversion: 2.1 time: 0.440356 Jan 27 16:52:48.799698 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 376/770] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:48 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:52:48.816344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9433f57-f243-41b4-9ef7-29eefe25348e", "device": "/dev/sdb"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:48.817445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:48.823598 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.824068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:48.824857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:48.825292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.066361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d6146fde-d38e-47e6-8ac6-6e8b22d43177 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "POST /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255527 Jan 27 16:52:49.071378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 395/771] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:52:48 2022] POST /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:49.539613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f36a3758-1924-416b-bc7d-027e79683d62"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:49.540706 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:49.547707 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:49.548095 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.548918 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:49.549327 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.798912 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:49.799883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:49.808990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:49.809566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.810621 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:49.811250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.897372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c8a269081c42abae453a5be4772d50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '326cd822c847423ba2417f593ca8c6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:52:49.915352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3082bdf6-1387-4d12-8cab-d6bc89a68b41 tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 200 len: 1479 microversion: 2.1 time: 0.123990 Jan 27 16:52:49.920516 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 396/772] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:49 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 1479 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:52:49.964162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-5e091c44-b1ac-4a85-87f5-3b4c1a29575a req-a36386c4-685f-4614-9da6-62e800da236a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2", "name": "network-vif-deleted", "tag": "0f3362f6-2e54-4b45-89fc-94c7ecae5a49"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:52:49.965953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:52:49.965953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:52:49.977150 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5e091c44-b1ac-4a85-87f5-3b4c1a29575a req-a36386c4-685f-4614-9da6-62e800da236a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:49.977617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-5e091c44-b1ac-4a85-87f5-3b4c1a29575a req-a36386c4-685f-4614-9da6-62e800da236a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:49.991632 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-5e091c44-b1ac-4a85-87f5-3b4c1a29575a req-a36386c4-685f-4614-9da6-62e800da236a service nova] Creating event network-vif-deleted:0f3362f6-2e54-4b45-89fc-94c7ecae5a49 for instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 on hv-cinder-81883 Jan 27 16:52:49.998237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-5e091c44-b1ac-4a85-87f5-3b4c1a29575a req-a36386c4-685f-4614-9da6-62e800da236a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037962 Jan 27 16:52:49.998883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 397/773] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:52:50.007424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d5d0b239-d3d4-49d5-9379-73451553d42b tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471399 Jan 27 16:52:50.008064 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 377/774] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:52:49 2022] POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:52:50.934975 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:50.935713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] [instance: 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:50.943065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:50.943641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:50.944423 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:50.944859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:50.957536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] HTTP exception thrown: Instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 could not be found. Jan 27 16:52:50.958110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] Returning 404 to user: Instance 0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:52:50.958916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f6ce83da-4da5-4ca9-9b5a-13a323d28f8d tempest-ServerRescueNegativeTestJSON-2020386037 tempest-ServerRescueNegativeTestJSON-2020386037-project] 10.222.0.48 "GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2" status: 404 len: 111 microversion: 2.1 time: 0.027950 Jan 27 16:52:50.959441 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 398/775] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:52:50 2022] GET /compute/v2.1/servers/0cc31cb6-b4dc-4617-a6a6-2a31edcbbfe2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:51.029590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:52:51.030150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:52:51.036581 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:51.037029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:51.037804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:52:51.038239 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:52:51.118984 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lazy-loading 'services' on Instance uuid 27dbabab-3baf-4446-aaad-bdd80b162cd7 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:52:51.191972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a499ffb3-3e05-4ec4-95a4-127d42a346af tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments/47b33c5f-d8d0-46e7-a5d9-8c8e1501afeb" status: 202 len: 0 microversion: 2.1 time: 0.166214 Jan 27 16:52:51.193137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 378/776] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:52:51 2022] DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments/47b33c5f-d8d0-46e7-a5d9-8c8e1501afeb => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:53:08.036402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:08.037025 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:08.043335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:08.043819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:08.044604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:08.045041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:08.106964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c189f0b5-a34e-4161-b756-475bd9449d15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:08.113854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c189f0b5-a34e-4161-b756-475bd9449d15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:08.114501 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c189f0b5-a34e-4161-b756-475bd9449d15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:08.142618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c189f0b5-a34e-4161-b756-475bd9449d15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Going to try to stop instance {{(pid=127795) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 27 16:53:08.193607 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:08.198863 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c189f0b5-a34e-4161-b756-475bd9449d15 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 202 len: 0 microversion: 2.1 time: 0.096772 Jan 27 16:53:08.200332 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 379/777] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:53:08 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:53:08.201669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9197456a-c591-4faa-aaa6-fc5dc5fec4cf tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1595 microversion: 2.1 time: 0.168880 Jan 27 16:53:08.202285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 399/778] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:08 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1595 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:08.209993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:08.210687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:08.223842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:08.223842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:08.223842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:08.223842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:08.364377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:08.373058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c7a3c3e9-b611-42cf-a3c2-43f8a0d55a1b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.166885 Jan 27 16:53:08.373737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 380/779] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:08 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:09.393033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:09.393632 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:09.400024 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:09.400469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:09.401240 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:09.401676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:09.552580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:09.560840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-01be903b-fdb8-4a1e-839f-04466a35e100 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.172706 Jan 27 16:53:09.563706 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 400/780] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:09 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:10.216020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-1247b14a-be71-4345-8206-82276f66a015 req-3829e8ba-d8ca-4706-a2b3-45d2f534e8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:10.218032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:53:10.218032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:53:10.225251 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-1247b14a-be71-4345-8206-82276f66a015 req-3829e8ba-d8ca-4706-a2b3-45d2f534e8b8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:10.225691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-1247b14a-be71-4345-8206-82276f66a015 req-3829e8ba-d8ca-4706-a2b3-45d2f534e8b8 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:10.237521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-1247b14a-be71-4345-8206-82276f66a015 req-3829e8ba-d8ca-4706-a2b3-45d2f534e8b8 service nova] Creating event network-changed:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:53:10.242563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-1247b14a-be71-4345-8206-82276f66a015 req-3829e8ba-d8ca-4706-a2b3-45d2f534e8b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030536 Jan 27 16:53:10.243156 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 381/781] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:53:10.578802 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:10.579431 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:10.587244 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:10.588045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:10.589170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:10.589771 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:10.763935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:10.774256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-da3f56aa-224d-437f-8498-fb1e4af7c470 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.199801 Jan 27 16:53:10.774878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 401/782] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:10 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:11.368836 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-84671400"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:11.369449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:11.376445 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.376898 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:11.377678 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.378115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:11.501453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:11.502032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:11.513750 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.network.security_group_api [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Adding security group 916d14d8-7f52-490d-840a-6eda3f112a25 to port bdf14445-13aa-42c8-8538-0e113ea22eb2 Jan 27 16:53:11.516773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.517487 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:11.518285 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.518745 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:11.606633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lazy-loading 'services' on Instance uuid e6b36243-1023-4580-b4d7-75cdc8f89235 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:53:11.689577 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-df9eb8b4-50b4-48c8-932c-3f8ce042292b tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235/os-volume_attachments/c9433f57-f243-41b4-9ef7-29eefe25348e" status: 202 len: 0 microversion: 2.1 time: 0.187484 Jan 27 16:53:11.691039 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 402/783] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:53:11 2022] DELETE /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235/os-volume_attachments/c9433f57-f243-41b4-9ef7-29eefe25348e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:53:11.792836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:11.794304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:11.802117 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.802803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:11.804477 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:11.805179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.037071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d8e1851e-a09c-4c8d-9f0c-53d8347e4376 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action" status: 202 len: 0 microversion: 2.1 time: 0.672693 Jan 27 16:53:12.037668 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 382/784] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:53:11 2022] POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:53:12.045131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:12.046821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:12.048734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:12.053743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.054487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.055283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.055764 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.056213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f379677c-818e-40e2-9717-3f7d894a3c32 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.268200 Jan 27 16:53:12.056998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 403/785] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:11 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:53:12.061620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-7db60e87-df96-4d0b-9614-40870583df66 req-eb1d1388-e542-45b8-8283-88f4e08a3f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:12.063142 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:53:12.063142 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:53:12.073483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-7db60e87-df96-4d0b-9614-40870583df66 req-eb1d1388-e542-45b8-8283-88f4e08a3f64 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.073929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-7db60e87-df96-4d0b-9614-40870583df66 req-eb1d1388-e542-45b8-8283-88f4e08a3f64 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.097886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-7db60e87-df96-4d0b-9614-40870583df66 req-eb1d1388-e542-45b8-8283-88f4e08a3f64 service nova] Creating event network-changed:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:53:12.102862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-7db60e87-df96-4d0b-9614-40870583df66 req-eb1d1388-e542-45b8-8283-88f4e08a3f64 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044826 Jan 27 16:53:12.103507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 404/786] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:53:12.221446 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:12.230163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dffa285d-cccd-495c-9256-b716236ff61c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1759 microversion: 2.1 time: 0.188419 Jan 27 16:53:12.231103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 383/787] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:12 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1759 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:53:12.825103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:12.825673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:12.833924 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.834428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.835292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.835784 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.862114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:53:12.942282 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-eb4d707a-4bf1-4d6f-9465-e701c8b564f2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 204 len: 0 microversion: 2.1 time: 0.121377 Jan 27 16:53:12.943087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 405/788] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:53:12 2022] DELETE /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:53:12.950770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:12.951532 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:12.958721 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.959167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:12.959983 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:12.960412 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:13.076435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:13.077480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:13.086272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:13.086984 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:13.088041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:13.088878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:13.096920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:13.107100 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2cb384a1-88dd-49a0-a03c-9612de3b11c2 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1513 microversion: 2.1 time: 0.159563 Jan 27 16:53:13.109607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 384/789] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:12 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:13.236183 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:13.243929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-919eeeb5-00ee-4190-abf0-97da0ef39a66 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.174171 Jan 27 16:53:13.244508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 406/790] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:13 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:14.125599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:14.126211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:14.132623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:14.133062 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:14.133828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:14.134257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:14.260477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:14.260678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:14.261291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:14.268496 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:14.268670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e276b58c-4db2-4eb7-af75-08892f8bbfbe tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1513 microversion: 2.1 time: 0.146664 Jan 27 16:53:14.268948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:14.269409 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 385/791] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:14 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:14.269733 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:14.270168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:14.396435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:14.403947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b7947d88-b511-4a37-aedc-0cc950ab6ae1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.146883 Jan 27 16:53:14.404502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 407/792] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:14 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:53:15.286323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:15.287030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:15.293489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:15.293938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:15.294748 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:15.295179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:15.421776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:15.422535 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:15.424794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f0c0ea1e431437880ed43ef1c9cb1bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ae6dda115477db147059df89ad002', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:15.429061 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:15.429514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:15.430319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:15.430969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:15.432781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9bf2be44-7234-4e0e-98a1-55bda4e04991 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 200 len: 1513 microversion: 2.1 time: 0.150251 Jan 27 16:53:15.434648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 386/793] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:15 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:15.560146 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:15.568164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-73d2e98c-33a7-4d1f-a5f1-5bf86734fb9d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.150478 Jan 27 16:53:15.568734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 408/794] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:15 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:53:15.712377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-790fc134-fe8c-4893-9768-a88897543f26 req-87618784-e0d0-47b2-82e2-bde8189bd034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b36243-1023-4580-b4d7-75cdc8f89235", "name": "network-vif-deleted", "tag": "ff94a552-d3cc-4af3-b145-4bd0250f04cb"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:15.713965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:53:15.713965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:53:15.721513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-790fc134-fe8c-4893-9768-a88897543f26 req-87618784-e0d0-47b2-82e2-bde8189bd034 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:15.721955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-790fc134-fe8c-4893-9768-a88897543f26 req-87618784-e0d0-47b2-82e2-bde8189bd034 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:15.734217 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-790fc134-fe8c-4893-9768-a88897543f26 req-87618784-e0d0-47b2-82e2-bde8189bd034 service nova] Creating event network-vif-deleted:ff94a552-d3cc-4af3-b145-4bd0250f04cb for instance e6b36243-1023-4580-b4d7-75cdc8f89235 on hv-cinder-81883 Jan 27 16:53:15.739793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-790fc134-fe8c-4893-9768-a88897543f26 req-87618784-e0d0-47b2-82e2-bde8189bd034 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030961 Jan 27 16:53:15.740375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 387/795] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:53:16.449931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:16.450538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] [instance: e6b36243-1023-4580-b4d7-75cdc8f89235] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:16.457624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:16.458066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:16.458838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:16.459266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:16.472460 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] HTTP exception thrown: Instance e6b36243-1023-4580-b4d7-75cdc8f89235 could not be found. Jan 27 16:53:16.473028 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] Returning 404 to user: Instance e6b36243-1023-4580-b4d7-75cdc8f89235 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:53:16.473823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4f533c81-8975-4e44-af48-8d19ce46fc77 tempest-VolumesSnapshotTestJSON-1199942466 tempest-VolumesSnapshotTestJSON-1199942466-project] 10.222.0.48 "GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235" status: 404 len: 111 microversion: 2.1 time: 0.027574 Jan 27 16:53:16.474337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 409/796] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:16 2022] GET /compute/v2.1/servers/e6b36243-1023-4580-b4d7-75cdc8f89235 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:53:16.585011 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:16.585741 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:16.592174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:16.593393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:16.594188 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:16.594619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:16.942540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:16.949853 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f43adec0-18dc-46dc-9823-4c3bcc8d03eb tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.368766 Jan 27 16:53:16.950415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 388/797] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:16 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:17.966875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:17.967973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:17.974137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:17.974586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:17.975345 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:17.975797 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:18.100906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:18.109026 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b51d9b2e-f221-43c8-bd9f-3674dc6fee5d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.144810 Jan 27 16:53:18.109590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 410/798] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:17 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:19.126093 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:19.126703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:19.132926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:19.133371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:19.134143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:19.134576 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:19.262517 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:19.270838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8dbd9f9c-7c6d-49d2-a7cc-1f95aa738278 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.148893 Jan 27 16:53:19.271401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 389/799] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:19 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:20.288355 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:20.288963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:20.295692 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:20.296545 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:20.297311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:20.297741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:20.424229 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:20.431529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-51ef63b7-f5bc-4986-b750-44015a69a7c3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1677 microversion: 2.1 time: 0.146766 Jan 27 16:53:20.432125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 411/800] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:20 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:21.449515 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:21.450080 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:21.456315 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:21.456756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:21.457526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:21.457960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:21.586680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:21.595146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f34c3e60-cb87-4000-bb07-9ef81c4ddb76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1654 microversion: 2.1 time: 0.149384 Jan 27 16:53:21.595735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 390/801] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:21 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:21.611664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-784d47aa-b859-4cc8-97a2-ab9cdd8edc74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:21.617879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-784d47aa-b859-4cc8-97a2-ab9cdd8edc74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:21.618325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-784d47aa-b859-4cc8-97a2-ab9cdd8edc74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:21.639434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-784d47aa-b859-4cc8-97a2-ab9cdd8edc74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Going to try to start instance {{(pid=127796) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 27 16:53:21.680341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-784d47aa-b859-4cc8-97a2-ab9cdd8edc74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action" status: 202 len: 0 microversion: 2.1 time: 0.072832 Jan 27 16:53:21.681883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 412/802] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:53:21 2022] POST /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:53:21.689340 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:21.690154 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:21.696580 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:21.697054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:21.697868 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:21.698358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:21.827622 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:21.834985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-039ef7ef-138f-434e-8a20-821791f8af88 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1663 microversion: 2.1 time: 0.149678 Jan 27 16:53:21.835558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 391/803] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:21 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:22.853589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:22.854230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:22.861299 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:22.861712 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:22.862489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:22.862904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:22.989372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:22.996579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-80d7b4b3-ed33-4e56-bc15-4b2c87f126a5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1663 microversion: 2.1 time: 0.147521 Jan 27 16:53:22.997137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 413/804] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:22 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1663 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:24.014556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:24.015219 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:24.021681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:24.022134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:24.022909 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:24.023343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:24.152469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:24.161219 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-78f4f2a7-4f5a-410f-8373-81c3ac5c01bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1663 microversion: 2.1 time: 0.150894 Jan 27 16:53:24.161786 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 392/805] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:24 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:25.178096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:25.178635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:25.184967 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:25.185416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:25.186199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:25.186632 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:25.313066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:25.320262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-61f55486-8c3d-4479-b915-7b9cf043040a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1663 microversion: 2.1 time: 0.145883 Jan 27 16:53:25.320830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 414/806] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:25 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:26.337733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:26.338348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:26.344362 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:26.344805 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:26.345571 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:26.346003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:26.472422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:26.479710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f59bd285-8d9f-4ce1-83b3-4946b4e3658a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1663 microversion: 2.1 time: 0.145725 Jan 27 16:53:26.480268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 393/807] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:26 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1663 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:27.496171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:27.496774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:27.503501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:27.503980 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:27.504750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:27.505179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:27.638529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:27.646168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-154a8669-67be-49ea-b24c-8b721de1f91a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1667 microversion: 2.1 time: 0.153652 Jan 27 16:53:27.646732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 415/808] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:27 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:44.323695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:44.324305 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:44.330798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.331254 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.332066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.332646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.364424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ee5dc84a-f947-4ee4-b038-fd04cb1299a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments/db7151f2-172b-4a04-8de5-2b80eba04acb" status: 200 len: 194 microversion: 2.20 time: 0.044551 Jan 27 16:53:44.365006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 394/809] 10.222.0.48 () {60 vars in 1453 bytes} [Thu Jan 27 16:53:44 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments/db7151f2-172b-4a04-8de5-2b80eba04acb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:53:44.426254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:44.426841 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:44.433172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.433705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.434542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.435645 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.630899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lazy-loading 'services' on Instance uuid f7ddbd2c-1d14-4efe-9228-3feaa97ef620 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:53:44.702017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-992b4d27-3d50-4e96-aa7a-09dd421086b7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments/db7151f2-172b-4a04-8de5-2b80eba04acb" status: 202 len: 0 microversion: 2.20 time: 0.279234 Jan 27 16:53:44.705948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 416/810] 10.222.0.48 () {60 vars in 1456 bytes} [Thu Jan 27 16:53:44 2022] DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments/db7151f2-172b-4a04-8de5-2b80eba04acb => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:53:44.715338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:44.717251 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:44.723938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.724385 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.725260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:44.725693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:44.761259 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-38dfa8db-984c-4711-82da-f149402f67b6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053417 Jan 27 16:53:44.762163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 395/811] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jan 27 16:53:44 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:53:45.774863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:45.776063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:45.782806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:45.783255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:45.784102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:45.784538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:45.817380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-136d1ec1-94eb-41bf-8c26-e07a49ea1d01 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047134 Jan 27 16:53:45.817964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 417/812] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jan 27 16:53:45 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:45.875025 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:45.875526 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:45.881759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:45.882210 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:45.882987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:45.883424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:45.907829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:53:45.981138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cdb03b79-6cae-4180-a718-d66d750eba88 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 204 len: 0 microversion: 2.20 time: 0.110135 Jan 27 16:53:45.982575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 396/813] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jan 27 16:53:45 2022] DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 27 16:53:45.991581 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:45.992206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:45.999093 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:45.999534 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:46.000349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:46.000779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:46.054695 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:53:46.054867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 16:53:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 (ip 10.222.0.48) !!! Jan 27 16:53:46.137438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:46.146320 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:46.147823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:46.148989 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7cbc9a33-e442-489f-a525-aa1fa3bd821c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.162251 Jan 27 16:53:46.149535 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 418/814] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:45 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:47.168134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:47.168751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:47.175523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:47.176073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:47.176844 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:47.177278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:47.516803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:47.525063 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:47.526550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:47.527825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-36ecb0d1-61a6-4e2b-8e94-f93df76e2e47 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1721 microversion: 2.20 time: 0.363832 Jan 27 16:53:47.528436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 397/815] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:47 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:48.499037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-89e885b0-a977-4252-8340-8d35d76832e4 req-b8fce91f-17d1-43c9-9b39-b6b6af48ef76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ddbd2c-1d14-4efe-9228-3feaa97ef620", "name": "network-vif-deleted", "tag": "abeda3c4-6ebc-46ec-9c5e-ff3315222ece"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:48.501349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:53:48.501349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:53:48.524639 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-89e885b0-a977-4252-8340-8d35d76832e4 req-b8fce91f-17d1-43c9-9b39-b6b6af48ef76 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:48.525693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-89e885b0-a977-4252-8340-8d35d76832e4 req-b8fce91f-17d1-43c9-9b39-b6b6af48ef76 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:48.539457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-89e885b0-a977-4252-8340-8d35d76832e4 req-b8fce91f-17d1-43c9-9b39-b6b6af48ef76 service nova] Creating event network-vif-deleted:abeda3c4-6ebc-46ec-9c5e-ff3315222ece for instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 on hv-cinder-81883 Jan 27 16:53:48.549920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:48.551277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:48.566880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-89e885b0-a977-4252-8340-8d35d76832e4 req-b8fce91f-17d1-43c9-9b39-b6b6af48ef76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073968 Jan 27 16:53:48.568274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:48.568722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:48.569520 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:48.570162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 419/816] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:53:48.570887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:48.653920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:48.664282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:48.666161 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:48.667863 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ecea010a-3677-4a7d-be8f-8532baa7235f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 200 len: 1365 microversion: 2.20 time: 0.125793 Jan 27 16:53:48.680112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 398/817] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:48 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:49.687885 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:49.688686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:49.696029 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:49.696477 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:49.697256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:49.697693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:49.712590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. Jan 27 16:53:49.713373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:53:49.714405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-00be0367-9d2c-4e63-921f-8dcb663cdc1e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 404 len: 111 microversion: 2.20 time: 0.031731 Jan 27 16:53:49.718753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 420/818] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:49 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:53:49.723788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ed4ecbf2-0d7a-4813-bdde-6fc610f111bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '.version_select at 0x7f0cf0d28280>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:49.756560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ed4ecbf2-0d7a-4813-bdde-6fc610f111bb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837299887" status: 204 len: 0 microversion: 2.20 time: 0.036611 Jan 27 16:53:49.757138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 399/819] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jan 27 16:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837299887 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:53:50.435627 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: .version_select at 0x7f0cf047b0d0>, body: {"keypair": {"name": "tempest-keypair-489945461"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:50.449223 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:53:50.453825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:53:50.693573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:53:50.697696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:53:50.718894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0de0b8ec-1574-4a8c-b0a6-689c3ff86699 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.287607 Jan 27 16:53:50.719781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 421/820] 10.222.0.48 () {62 vars in 1198 bytes} [Thu Jan 27 16:53:50 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 289 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 27 16:53:51.887048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:51.889321 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:51.898161 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:51.899585 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:51.900715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:51.901459 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:51.990619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fea6ecb2-1620-49e4-8088-4d5843471030 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action" status: 202 len: 0 microversion: 2.1 time: 0.108408 Jan 27 16:53:51.994195 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 400/821] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:53:51 2022] POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:53:52.000466 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:52.001138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:52.014208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:52.015028 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:52.017361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:52.022922 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:52.192328 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:52.202823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-67ea39b4-ef9b-4a3f-b577-3a43ef1dcd23 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1751 microversion: 2.1 time: 0.207313 Jan 27 16:53:52.204324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 422/822] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:51 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:52.225731 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-691131384", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e17d67f-4d84-42b2-a3bf-cf48fd71687d"}], "security_groups": [{"name": "tempest-securitygroup--555754688"}], "key_name": "tempest-keypair-489945461", "user_data": "}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:52.333288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] validate_networks() for [('4e17d67f-4d84-42b2-a3bf-cf48fd71687d', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:53:52.920960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:53:52.921530 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:53:52.922141 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:53:52.922889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:53:52.925633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:53:52.937779 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:52.938312 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:52.939180 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:52.939720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:52.956260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for project 11d012d792424a858b876a618c79f7af. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:53:52.960203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Getting quotas for user dd2a59a36a2e422795e977c7af5004e6 and project 11d012d792424a858b876a618c79f7af. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:53:52.972322 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:53:52.974754 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:53:53.021234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-41c032ae-a43c-400b-a46b-3f6c1d598af7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.799849 Jan 27 16:53:53.022030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 401/823] 10.222.0.48 () {62 vars in 1187 bytes} [Thu Jan 27 16:53:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 27 16:53:53.032378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:53.033076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:53.094245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:53.101539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:53.103300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:53.104445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e4d040b7-73f6-47c1-b858-13ae37119266 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1280 microversion: 2.20 time: 0.076391 Jan 27 16:53:53.105172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 423/824] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:53 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:53.220933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:53.221370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:53.228794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:53.229232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:53.230309 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:53.230745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:53.415939 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:53.425772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6d3b06dd-2940-4bc8-b589-30a4f8eabb19 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.208718 Jan 27 16:53:53.426530 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 402/825] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:53 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:54.121877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:54.122944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:54.129286 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:54.129738 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:54.130526 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:54.131058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:54.232471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:54.243297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:54.245112 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:54.246723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b63f34b7-b7a7-4354-86a7-164993af1e08 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1332 microversion: 2.20 time: 0.128198 Jan 27 16:53:54.247676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 424/826] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:54 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:54.442845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:54.443479 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:54.449630 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:54.450933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:54.451756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:54.452197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:54.619436 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:54.630557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-19c65217-5cc4-42de-8150-40ad1f921204 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.191295 Jan 27 16:53:54.631142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 403/827] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:54 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:55.265514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:55.266589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:55.272727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:55.273178 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:55.273963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:55.274396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:55.420619 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:55.432629 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:55.435819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:55.437177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4e012e0f-17d3-43f7-bcaf-db900baf2098 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.175857 Jan 27 16:53:55.452632 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 425/828] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:55 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:55.649084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:55.650328 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:55.658220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:55.658952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:55.659942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:55.660563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:55.687328 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-6f259455-bb60-4b76-a04e-47df17fb3bdd req-836d533e-6d4c-478d-b87c-b11d75b8de0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:53:55.689365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:53:55.689365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:53:55.714066 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-6f259455-bb60-4b76-a04e-47df17fb3bdd req-836d533e-6d4c-478d-b87c-b11d75b8de0d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:55.714500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-6f259455-bb60-4b76-a04e-47df17fb3bdd req-836d533e-6d4c-478d-b87c-b11d75b8de0d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:55.733762 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-6f259455-bb60-4b76-a04e-47df17fb3bdd req-836d533e-6d4c-478d-b87c-b11d75b8de0d service nova] Creating event network-changed:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:53:55.740097 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-6f259455-bb60-4b76-a04e-47df17fb3bdd req-836d533e-6d4c-478d-b87c-b11d75b8de0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062115 Jan 27 16:53:55.741846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 426/829] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:53:55.848602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:55.857508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d51c4354-fde3-4b62-b8d5-87b3343277fa tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.213240 Jan 27 16:53:55.858101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 404/830] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:55 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:56.460195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:56.460901 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:56.468744 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:56.469923 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:56.470854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:56.471371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:56.619774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:56.628404 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:56.629886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:56.631008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-77f48ce3-2cc6-481f-b4de-a9423c42f0f8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.175387 Jan 27 16:53:56.631622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 427/831] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:56 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:56.873955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:56.874576 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:56.880806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:56.881242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:56.882031 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:56.882440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:57.023171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:57.031525 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5774448a-910e-4276-a401-f9fd5d702968 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.161191 Jan 27 16:53:57.032124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 405/832] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:56 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:57.649657 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:57.650280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:57.656900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:57.657349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:57.658162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:57.658597 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:57.808547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:57.817007 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:57.818520 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:57.819656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a9990762-0208-448e-98d6-fdc341da5fa3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.173723 Jan 27 16:53:57.820213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 428/833] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:57 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:58.048944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:58.049583 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:58.055765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:58.056263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:58.056974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:58.057400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:58.196751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:58.204435 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5194f7c6-c456-4442-a66f-5f09636b50b4 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.159155 Jan 27 16:53:58.204990 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 406/834] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:58 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:53:58.837573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:58.838187 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:58.845466 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:58.845908 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:58.846690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:58.847118 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:58.992370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:59.000515 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:59.002109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:59.003334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a036fa51-3456-4faf-bab3-1127b6c36912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.169428 Jan 27 16:53:59.004007 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 429/835] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:53:58 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:53:59.222302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:53:59.223756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:53:59.231815 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:59.232519 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:59.234059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:53:59.234667 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:53:59.427186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:53:59.435816 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b064ab4e-f54f-48ee-8a0f-6ba5a9333bf3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.217034 Jan 27 16:53:59.436389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 407/836] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:53:59 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:00.020780 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:00.021396 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:00.027720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:00.028182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:00.028965 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:00.029398 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:00.181388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:00.191319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:00.192852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:00.194211 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c387f82c-b1d0-40f3-a061-e476379b0ef0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.177165 Jan 27 16:54:00.194828 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 430/837] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:00 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:00.452459 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:00.453078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:00.459311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:00.459791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:00.460570 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:00.461000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:00.611009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:00.618903 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-34737840-5991-4c53-ab88-f38599079ffc tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.169995 Jan 27 16:54:00.619391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 408/838] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:00 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:00.837812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-2627dccb-6798-456a-bc21-ec8d851bb338 req-270a13af-53a6-496a-b888-6080a1b5dd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "name": "network-vif-plugged", "status": "completed", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:00.841562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:00.841562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:00.851253 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2627dccb-6798-456a-bc21-ec8d851bb338 req-270a13af-53a6-496a-b888-6080a1b5dd5c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:00.852397 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-2627dccb-6798-456a-bc21-ec8d851bb338 req-270a13af-53a6-496a-b888-6080a1b5dd5c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:00.867964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-2627dccb-6798-456a-bc21-ec8d851bb338 req-270a13af-53a6-496a-b888-6080a1b5dd5c service nova] Creating event network-vif-plugged:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:54:00.873456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-2627dccb-6798-456a-bc21-ec8d851bb338 req-270a13af-53a6-496a-b888-6080a1b5dd5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041972 Jan 27 16:54:00.874315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 431/839] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:01.212407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:01.213022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:01.219139 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:01.219613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:01.220386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:01.220822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:01.397035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:01.405778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:01.407283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:01.408487 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c85b263c-b80a-4883-97b6-64eb09c1f856 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1405 microversion: 2.20 time: 0.199773 Jan 27 16:54:01.409048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 409/840] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:01 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:01.637810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:01.638608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:01.645514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:01.646082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:01.646938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:01.647439 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:01.792249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:01.800695 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0d632e95-bdc3-47d7-aa5a-8755c790bd79 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.168108 Jan 27 16:54:01.801255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 432/841] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:01 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:02.428068 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:02.428709 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:02.436295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.436758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:02.437618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.438130 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:02.596809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:02.604740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:02.606337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:02.607544 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0ac64bbb-1736-466f-b829-ced7ecaf98e0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1598 microversion: 2.20 time: 0.184101 Jan 27 16:54:02.608115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 410/842] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:02 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1598 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:02.625620 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:02.626102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:02.631869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.632315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:02.633076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.633528 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:02.710351 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6467de08-ec5c-4a81-8b79-07b384405afa tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088926 Jan 27 16:54:02.710943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 433/843] 10.222.0.48 () {60 vars in 1315 bytes} [Thu Jan 27 16:54:02 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:54:02.818085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:02.818763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:02.825605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.826073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:02.826847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:02.827275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:03.094142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:03.101998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8c89f97e-87a6-4f26-b433-f09911c01343 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.287618 Jan 27 16:54:03.102554 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 411/844] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:02 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:03.968786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:03.970231 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:03.970992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-63a7be27-855f-4af6-b29b-8005bc54245d req-44c08f40-0ffb-42ff-b8b6-0d9154c9a9b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:03.972795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:03.972795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:54:03.976419 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:03.977051 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:03.977856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:03.978290 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:03.980701 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-63a7be27-855f-4af6-b29b-8005bc54245d req-44c08f40-0ffb-42ff-b8b6-0d9154c9a9b9 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:03.981785 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-63a7be27-855f-4af6-b29b-8005bc54245d req-44c08f40-0ffb-42ff-b8b6-0d9154c9a9b9 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:03.993038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-63a7be27-855f-4af6-b29b-8005bc54245d req-44c08f40-0ffb-42ff-b8b6-0d9154c9a9b9 service nova] Creating event network-changed:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:54:03.998529 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-63a7be27-855f-4af6-b29b-8005bc54245d req-44c08f40-0ffb-42ff-b8b6-0d9154c9a9b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031342 Jan 27 16:54:03.999839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 412/845] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:04.120633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:04.122023 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:04.128218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:04.128663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:04.129445 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:04.129873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:04.272717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:04.280953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1f9b4b3f-5037-4938-9d44-36a92fcb8aab tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.164284 Jan 27 16:54:04.281522 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 413/846] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:04 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:05.299013 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:05.299653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:05.305858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:05.306309 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:05.307079 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:05.307513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:05.449348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:05.457661 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d725dc45-039d-41e2-8131-6bb4e735802c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.162336 Jan 27 16:54:05.458232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 414/847] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:05 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:06.473674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:06.474330 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:06.481423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.482031 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.482807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.483246 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.524692 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9d9c9eec-9aa6-4400-af89-409bdfacec5a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 2.560550 Jan 27 16:54:06.525991 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 434/848] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:03 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 2562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:06.628002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:06.635733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e0562276-8911-4824-a0f7-315f9e6e0ff2 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.165625 Jan 27 16:54:06.636317 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 415/849] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:06 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:06.792055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:06.793146 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:06.800007 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.800451 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.801224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.801653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.831247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1f14cd76-b7b6-4d93-ace6-0b88c2130cea tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043303 Jan 27 16:54:06.831835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 435/850] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:54:06 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:06.898814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:06.899333 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:06.906119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.906577 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.907362 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:06.907834 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:06.942666 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:54:07.040313 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f41abf57-2d29-48b4-8f29-d527509376a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 204 len: 0 microversion: 2.1 time: 0.144804 Jan 27 16:54:07.040904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 416/851] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:54:06 2022] DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:54:07.049090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:07.049798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:07.055899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.056343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.057110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.057543 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.191237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:07.198527 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-dd69c1b0-116a-474d-bc97-42d26aab5258 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1673 microversion: 2.1 time: 0.153148 Jan 27 16:54:07.199801 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 436/852] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:07 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:07.653580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:07.654226 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:07.660186 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.660640 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.661425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.661863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.690988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:07.692291 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:07.698246 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.698770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.700148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:07.700653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:07.802260 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:07.810415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-edcb79bd-2e70-41bc-89a2-ef83c943513c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.161099 Jan 27 16:54:07.810969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 437/853] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:07 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:08.215812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:08.216363 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:08.222590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:08.223040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:08.223840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:08.224282 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:08.354811 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:08.362781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6110f14a-81a5-4f6f-adb9-55020b86116c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1673 microversion: 2.1 time: 0.150735 Jan 27 16:54:08.363339 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 438/854] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:08 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:08.826056 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:08.826747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:08.832871 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:08.833310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:08.834071 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:08.834502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:08.978462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:08.986209 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-00204b95-7273-4628-b290-e2b8b0479743 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.163944 Jan 27 16:54:08.986777 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 439/855] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:08 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:09.380438 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:09.381055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:09.387875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:09.388328 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:09.389101 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:09.389531 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:09.515552 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:09.522664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5ae1d1cd-00ea-446f-91ea-202e84376a7c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1673 microversion: 2.1 time: 0.145862 Jan 27 16:54:09.523258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 440/856] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:09 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1673 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:09.859038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fd7566b7-05f4-4410-868e-64c92f14ca5c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 2.326261 Jan 27 16:54:09.860058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 417/857] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:07 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 2328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:10.002490 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:10.003136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:10.009502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.009950 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.010724 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.011157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.160087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:10.169316 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8ee676e8-09aa-4ef3-8d8d-463d052550a3 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.170367 Jan 27 16:54:10.170012 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 441/858] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:09 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:10.541000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:10.542244 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:10.549760 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.550244 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.551044 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.551449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.682308 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:10.691086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0572f9bb-8f37-4f18-8bf0-0eca6a7ae31b tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1673 microversion: 2.1 time: 0.154089 Jan 27 16:54:10.691665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 418/859] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:10 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:10.869932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:10.871375 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:10.877216 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.877671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.878445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:10.878886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:10.941006 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-598c8b27-aea8-4682-a62d-3e20de314b9c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 0.074641 Jan 27 16:54:10.941633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 442/860] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:10 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:11.186775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:11.187640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:11.194016 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.194460 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:11.195229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.195693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:11.363894 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:11.372958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-58934755-01a2-4b27-891c-fc105b5d026d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.190398 Jan 27 16:54:11.373717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 419/861] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:11 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:11.709190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:11.710043 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:11.717430 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.717879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:11.718658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.719099 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:11.863392 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:11.870645 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5614d702-7209-4682-9324-6310d621098c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 200 len: 1673 microversion: 2.1 time: 0.165555 Jan 27 16:54:11.871544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 443/862] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:11 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:11.952528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:11.953583 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:11.960134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.960514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:11.961289 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:11.961717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.017977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-936a4c7e-5502-409d-992c-2fb6a6631bb6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 0.069764 Jan 27 16:54:12.021051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 420/863] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:11 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:12.154801 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-7d7a3a65-23eb-4504-902c-b04ba5501bc1 req-716a7d02-53f3-420a-ac1c-074b42b6e7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dbabab-3baf-4446-aaad-bdd80b162cd7", "name": "network-vif-deleted", "tag": "c7ee8f95-4b6c-4378-a74a-658d33610c09"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:12.156847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:12.156847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:12.165946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-7d7a3a65-23eb-4504-902c-b04ba5501bc1 req-716a7d02-53f3-420a-ac1c-074b42b6e7e7 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:12.166682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-7d7a3a65-23eb-4504-902c-b04ba5501bc1 req-716a7d02-53f3-420a-ac1c-074b42b6e7e7 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.179508 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-7d7a3a65-23eb-4504-902c-b04ba5501bc1 req-716a7d02-53f3-420a-ac1c-074b42b6e7e7 service nova] Creating event network-vif-deleted:c7ee8f95-4b6c-4378-a74a-658d33610c09 for instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 on hv-cinder-81883 Jan 27 16:54:12.185836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-7d7a3a65-23eb-4504-902c-b04ba5501bc1 req-716a7d02-53f3-420a-ac1c-074b42b6e7e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107941 Jan 27 16:54:12.186789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 444/864] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:54:12.390438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:12.391138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:12.398029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:12.398476 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.399302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:12.399713 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.564393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:12.576020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c401a8e7-699e-4996-bbb6-fdf1b046515c tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.188860 Jan 27 16:54:12.576020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 421/865] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:12 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:12.889781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:12.890899 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:12.897415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:12.897862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.898656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:12.899090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:12.914395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. Jan 27 16:54:12.914994 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:54:12.915865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-29953665-3161-47fe-8e9d-dcfdc3891039 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 404 len: 111 microversion: 2.1 time: 0.031425 Jan 27 16:54:12.916447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 445/866] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:12 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:12.925458 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a0f376fc-c694-4ffd-a21d-accc6eed8f9e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '.version_select at 0x7f0cf0d778b0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:12.947939 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a0f376fc-c694-4ffd-a21d-accc6eed8f9e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384134626" status: 202 len: 0 microversion: 2.1 time: 0.026422 Jan 27 16:54:12.948521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 422/867] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jan 27 16:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1384134626 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:13.029500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:13.030354 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:13.036432 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:13.036882 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:13.037667 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:13.038106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:13.593105 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:13.593841 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:13.600335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:13.600780 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:13.601560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:13.601997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:13.742634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:13.750319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d1b5b5f4-4738-4498-8365-f151ab78306d tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.162049 Jan 27 16:54:13.750879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 423/868] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:13 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:13.754986 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: .version_select at 0x7f0cf0ef80d0>, body: {"keypair": {"name": "tempest-keypair-1312010021"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:13.772837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:13.776599 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:14.130765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:14.134252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'key_pairs'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:14.147014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8f8703ec-d30e-4943-97a6-45f7ae0abba7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.395102 Jan 27 16:54:14.147662 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 424/869] 10.222.0.48 () {60 vars in 1157 bytes} [Thu Jan 27 16:54:13 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:14.767743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:14.768448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:14.774202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:14.774712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:14.775481 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:14.775938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:15.001974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:15.010003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a347a331-10b9-447b-812c-499d8fc11051 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.246296 Jan 27 16:54:15.010582 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 425/870] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:14 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:15.422405 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-734662894", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d4e5124e-533e-45d6-b9d3-79afca1c35e2"}], "security_groups": [{"name": "tempest-securitygroup--1822645270"}], "key_name": "tempest-keypair-1312010021", "user_data": "}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:15.484300 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7bb77153-4aef-482d-aac3-c6a0f23f5835 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 2.458989 Jan 27 16:54:15.487497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 446/871] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:13 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:15.519733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] validate_networks() for [('d4e5124e-533e-45d6-b9d3-79afca1c35e2', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:54:15.876502 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:54:15.877563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:54:15.878042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:54:15.878454 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:54:15.878862 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:54:15.899011 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:15.899462 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:15.900390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:15.900835 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:15.917737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for project accb650bdbfa4de4a4129fd473ca736d. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:15.921685 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Getting quotas for user 20137a83d3de4dcfaba05ab93c470829 and project accb650bdbfa4de4a4129fd473ca736d. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:15.933104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:54:15.935413 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:54:15.983024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e8b3f0e9-bc6d-4cb7-aa19-ed285592ba94 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564540 Jan 27 16:54:15.988282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 426/872] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:54:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:54:15.994635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-58827181-c4a3-425e-a938-636fd534a585 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:15.996930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-58827181-c4a3-425e-a938-636fd534a585 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:16.029019 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:16.029636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:16.037338 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:16.037795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:16.039912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:16.040364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:16.070266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-58827181-c4a3-425e-a938-636fd534a585 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:16.078215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-58827181-c4a3-425e-a938-636fd534a585 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1237 microversion: 2.1 time: 0.088125 Jan 27 16:54:16.088165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 447/873] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:15 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:16.220725 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:16.230690 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b81142c7-683c-457a-9db4-bc0a8ec43c64 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1756 microversion: 2.1 time: 0.205962 Jan 27 16:54:16.231823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 427/874] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:16 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:16.495179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:16.496910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:16.503705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:16.504153 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:16.504925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:16.505359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:16.562305 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9ca6d5e1-01e0-49f7-abcf-eb63f7909a84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 14 microversion: 2.20 time: 0.070669 Jan 27 16:54:16.565389 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 448/875] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:16 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:17.094286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:17.095880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:17.102178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.102624 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.103395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.103850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.172008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:17.184897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2e60ffd2-c5da-45c7-87b1-5abadacd03d3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1295 microversion: 2.1 time: 0.093825 Jan 27 16:54:17.185677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 428/876] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:17 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:17.249267 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:17.250044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:17.257002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.257788 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.258658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.259201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.420231 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:17.428436 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4497cb6f-1f59-4d8a-82e8-1fcfaf4a6919 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1759 microversion: 2.1 time: 0.183440 Jan 27 16:54:17.429217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 449/877] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:17 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:17.572759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:17.574824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:17.580730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.581229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.582099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.582535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.659381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cf4f7c57-5d2b-4106-bdfd-7cd4b32497b5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 8105 microversion: 2.20 time: 0.089787 Jan 27 16:54:17.663653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 429/878] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:17 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 8105 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:17.767489 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:17.768130 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:17.774682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.775136 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.776163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:17.776671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:17.954038 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lazy-loading 'flavor' on Instance uuid 7e2afd7a-cfd6-4228-b067-077d9f739343 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:54:18.025132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c1448ad4-7e4a-4b09-9662-444f83fbc020 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "POST /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343/action" status: 202 len: 0 microversion: 2.1 time: 0.262961 Jan 27 16:54:18.025724 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 450/879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:17 2022] POST /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:18.034579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:18.035278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:18.043054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.043493 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.044486 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.044913 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.190611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:18.198275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-59cd2b3e-edee-4305-a989-eaad6ad6a68d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.167612 Jan 27 16:54:18.199114 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 430/880] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:18 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:18.213388 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:18.214126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:18.221618 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.222292 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.223276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.223736 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.343017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d02be660-6a98-47d9-9e65-9f15d14e0c7b req-e1ee269f-e670-42ba-a0fb-91a0a3b26c1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c22100-7616-4a07-842e-64004815a6ca", "tag": "97743adb-f50c-4603-8490-a5dc53d3afb5"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:18.344694 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:18.344694 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:54:18.359518 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d02be660-6a98-47d9-9e65-9f15d14e0c7b req-e1ee269f-e670-42ba-a0fb-91a0a3b26c1e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.360014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d02be660-6a98-47d9-9e65-9f15d14e0c7b req-e1ee269f-e670-42ba-a0fb-91a0a3b26c1e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.378101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d02be660-6a98-47d9-9e65-9f15d14e0c7b req-e1ee269f-e670-42ba-a0fb-91a0a3b26c1e service nova] Creating event network-changed:97743adb-f50c-4603-8490-a5dc53d3afb5 for instance e8c22100-7616-4a07-842e-64004815a6ca on hv-cinder-81883 Jan 27 16:54:18.383347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d02be660-6a98-47d9-9e65-9f15d14e0c7b req-e1ee269f-e670-42ba-a0fb-91a0a3b26c1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046263 Jan 27 16:54:18.384145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 431/881] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:18.394825 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:18.403488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9f57e316-ada9-4277-ac06-d5672815a0f0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.194472 Jan 27 16:54:18.404106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 451/882] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:18 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:18.674477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:18.674477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:18.678965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.679533 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.680325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:18.680752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:18.758280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7caccbbb-0bff-4d6b-8494-2a65c7edfebc tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 15259 microversion: 2.20 time: 0.091307 Jan 27 16:54:18.762315 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 432/883] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:18 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 15259 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:19.216402 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:19.217008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:19.223150 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.223618 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.224384 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.224818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.356327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:19.363630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-003706e4-4109-4651-bdd1-afd5d283ecf8 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.151499 Jan 27 16:54:19.364188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 452/884] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:19 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:19.420900 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:19.421598 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:19.428391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.428837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.429605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.430036 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.566506 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:19.574007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4ba27f56-e85f-41cb-a986-ff586362bfec tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.157561 Jan 27 16:54:19.574380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 433/885] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:19 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:19.769842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:19.770805 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:19.777126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.777564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.778337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:19.778765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:19.857104 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8c1b6431-3ae2-4938-8580-e4153ab8e75c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 17931 microversion: 2.20 time: 0.090654 Jan 27 16:54:19.857736 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 453/886] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:19 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 17931 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:20.379992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:20.380641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:20.388117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.388545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.389331 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.390018 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.530473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:20.537740 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7f4d0a16-9fd2-4130-aa0e-7eb8cfea8a5d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.161334 Jan 27 16:54:20.538306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 434/887] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:20 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:20.590279 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:20.591001 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:20.597952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.598401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.599171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.599750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.731773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:20.739550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fff8c016-4b12-4e2f-807b-0edbbaa25cb5 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.153273 Jan 27 16:54:20.740130 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 454/888] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:20 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:20.868514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:20.869461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:20.876484 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.876926 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.877697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:20.878124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:20.950998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f9ad3057-02e1-4494-aa02-1ec060ab6778 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 19399 microversion: 2.20 time: 0.086042 Jan 27 16:54:20.951874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 435/889] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:20 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 19399 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:21.554071 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:21.554778 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:21.561325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.561779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:21.562596 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.563037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:21.701689 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:21.709247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-522ec212-3948-48c7-9ae8-316d65eaca01 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.158856 Jan 27 16:54:21.710055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 455/890] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:21 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:21.757457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:21.758163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:21.766127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.766518 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:21.767304 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.767850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:21.898165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:21.905845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-33ba0b17-3f3f-4dd3-a837-888162754288 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.152566 Jan 27 16:54:21.906410 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 436/891] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:21 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:21.962185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:21.963126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:21.969708 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.970159 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:21.970940 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:21.971377 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:22.046186 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5a6e5683-2e7e-4f61-91c6-893dec08dfb9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 22119 microversion: 2.20 time: 0.087481 Jan 27 16:54:22.049904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 456/892] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:21 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 22119 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:22.423286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1732989699", "imageRef": "5a995394-7c8f-4219-8058-923b3ea7058f", "flavorRef": "452"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:22.473374 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] validate_networks() for None {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:54:22.726626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:22.727359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:22.734393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:22.734836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:22.735672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:22.736109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:22.739371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:54:22.740538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:54:22.741197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:54:22.741620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:54:22.742026 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:54:22.751336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:22.751823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:22.752633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:22.753069 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:22.770710 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Getting quotas for project 7294a7a1631344cfa1e5a508f2a28289. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:22.774620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Getting quotas for user e9a8702ceb614c1dbfa6d8fc2f8a8862 and project 7294a7a1631344cfa1e5a508f2a28289. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:22.787015 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:54:22.789366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5a995394-7c8f-4219-8058-923b3ea7058f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:54:22.836185 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-be52a897-f9bb-4c13-8269-93ff1b9bba8a tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.416221 Jan 27 16:54:22.837053 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 437/893] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:54:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:54:22.846864 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7cce36ad-cd26-4fb0-a83f-def4400c4866 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:22.847386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7cce36ad-cd26-4fb0-a83f-def4400c4866 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:23.049132 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7cce36ad-cd26-4fb0-a83f-def4400c4866 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:23.058982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7cce36ad-cd26-4fb0-a83f-def4400c4866 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1215 microversion: 2.1 time: 0.215759 Jan 27 16:54:23.069592 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 438/894] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:22 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:23.070823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:23.071403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:23.079145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:23.079781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:23.080579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:23.081022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:23.116749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:23.125937 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-eabfdf22-fea1-4af8-96af-162ac0078c7d tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.403099 Jan 27 16:54:23.127048 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 457/895] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:22 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:23.132361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:23.133501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:23.143006 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:23.143693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:23.144626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:23.145174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:23.232266 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:23.233653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e7457207-a26a-4768-b25c-1b3d3516a620 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 23803 microversion: 2.20 time: 0.104974 Jan 27 16:54:23.234293 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 458/896] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:23 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 23803 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:23.239855 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cf4d5bff-5c83-4b5c-9e02-5261cfe84f26 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.178461 Jan 27 16:54:23.240417 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 439/897] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:23 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:23.825790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-8125ce81-1c37-4518-8324-c770f0f72690 req-f487ccda-6d91-474f-bab8-f3e9ffb57971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c22100-7616-4a07-842e-64004815a6ca", "name": "network-vif-plugged", "status": "completed", "tag": "97743adb-f50c-4603-8490-a5dc53d3afb5"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:23.827752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:23.827752 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:23.836153 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8125ce81-1c37-4518-8324-c770f0f72690 req-f487ccda-6d91-474f-bab8-f3e9ffb57971 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:23.836705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-8125ce81-1c37-4518-8324-c770f0f72690 req-f487ccda-6d91-474f-bab8-f3e9ffb57971 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:23.847816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-8125ce81-1c37-4518-8324-c770f0f72690 req-f487ccda-6d91-474f-bab8-f3e9ffb57971 service nova] Creating event network-vif-plugged:97743adb-f50c-4603-8490-a5dc53d3afb5 for instance e8c22100-7616-4a07-842e-64004815a6ca on hv-cinder-81883 Jan 27 16:54:23.852960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-8125ce81-1c37-4518-8324-c770f0f72690 req-f487ccda-6d91-474f-bab8-f3e9ffb57971 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154579 Jan 27 16:54:23.853641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 459/898] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:24.076610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:24.077453 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:24.083477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.084055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.084965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.085407 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.145052 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:24.145747 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:24.150585 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:24.153137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.153590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.154383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.154814 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.158714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6b27d495-413d-4930-bf2e-0fd4249c7238 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1273 microversion: 2.1 time: 0.086431 Jan 27 16:54:24.160965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 440/899] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:24 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:24.245302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:24.246632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:24.255753 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.256858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.258274 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.258904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.296226 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:24.303927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-21b86fc7-b737-4a3c-8e88-d29b0a14e362 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.162888 Jan 27 16:54:24.305454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 460/900] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:24 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:24.311407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:24.312080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:24.318301 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.318759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.319591 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:24.320170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:24.358513 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ce68c27d-9b3f-4742-b1ba-e50a2d1b3a52 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 24954 microversion: 2.20 time: 0.116909 Jan 27 16:54:24.360720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 441/901] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:24 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 24954 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:24.455879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:24.463157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-55ab7e58-d76c-47b0-8b52-7cf9e561049f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1363 microversion: 2.1 time: 0.156490 Jan 27 16:54:24.464268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 461/902] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:24 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:25.176775 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:25.177496 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:25.185029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.185469 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.186243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.186674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.321806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:25.322559 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:25.331055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:25.332255 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.332816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.334090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.334734 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.338584 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-72c3e5bb-5a1f-4f5e-b936-41f4cacf4700 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.165818 Jan 27 16:54:25.351879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 442/903] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:25 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:25.370604 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:25.372059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:25.390155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.390888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.391897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.392494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.488890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:25.505201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ced0ecd6-8bc8-476b-8cc6-b06acf2795d4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.187495 Jan 27 16:54:25.506763 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 462/904] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:25 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:25.511590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:25.512533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:25.515859 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4e8c5997-f9ed-4f1e-91d1-fb27d70af21f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 26253 microversion: 2.20 time: 0.149480 Jan 27 16:54:25.519341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.519768 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 443/905] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:25 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 26253 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:25.520020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.522148 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.522688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.606005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d0c3d48f-58d3-488c-b41a-b6f095b7e7a3 req-3ecc1e6f-b704-4931-a41f-671c23cc9c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c459aa7-348c-4db9-97a0-5533c0d86f9a", "tag": "82a9490c-72df-4c4e-b0c6-64baab7cd6ba"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:25.608136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:25.608136 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:54:25.619494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0c3d48f-58d3-488c-b41a-b6f095b7e7a3 req-3ecc1e6f-b704-4931-a41f-671c23cc9c42 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.619494 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0c3d48f-58d3-488c-b41a-b6f095b7e7a3 req-3ecc1e6f-b704-4931-a41f-671c23cc9c42 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.638027 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d0c3d48f-58d3-488c-b41a-b6f095b7e7a3 req-3ecc1e6f-b704-4931-a41f-671c23cc9c42 service nova] Creating event network-changed:82a9490c-72df-4c4e-b0c6-64baab7cd6ba for instance 9c459aa7-348c-4db9-97a0-5533c0d86f9a on hv-cinder-81883 Jan 27 16:54:25.643382 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d0c3d48f-58d3-488c-b41a-b6f095b7e7a3 req-3ecc1e6f-b704-4931-a41f-671c23cc9c42 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046325 Jan 27 16:54:25.644328 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 444/906] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:54:25.698882 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:25.712242 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-44c19d45-6874-4114-a9d2-ea50431648ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1548 microversion: 2.1 time: 0.203840 Jan 27 16:54:25.713254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 463/907] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:25 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:25.731516 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:25.732125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:25.738795 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.739239 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.740075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:25.740507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:25.842052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4e0b9015-77fd-49f9-aa74-ad035ba767e8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115758 Jan 27 16:54:25.842745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 445/908] 10.222.0.48 () {58 vars in 1274 bytes} [Thu Jan 27 16:54:25 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:54:26.355537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:26.356480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:26.365553 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.366100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.366963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.367495 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.529398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:26.530186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:26.538155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.538784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.539738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.540278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.649897 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:26.657851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3233314d-61ed-4e78-9b5e-7bff10e5b271 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.306558 Jan 27 16:54:26.658415 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 464/909] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:26 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:26.663003 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:26.664089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:26.670483 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.670934 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.671742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.672177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.747063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4e038328-f278-45e6-9869-86519976e89f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 27287 microversion: 2.20 time: 0.087244 Jan 27 16:54:26.750931 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 465/910] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:26 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 27287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:26.798649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:26.805942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4f827614-f2ee-43df-918e-2dd9184e857a tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.281977 Jan 27 16:54:26.806733 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 446/911] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:26 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:26.953824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:26.954967 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:26.962671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.963185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:26.964074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:26.964565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.020587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-7d4a4c89-6932-44ae-8977-95ff41075df7 req-fd7ecc28-516e-4111-ae18-8b274ea83287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c22100-7616-4a07-842e-64004815a6ca", "tag": "97743adb-f50c-4603-8490-a5dc53d3afb5"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:27.022146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:27.022146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:54:27.028794 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-7d4a4c89-6932-44ae-8977-95ff41075df7 req-fd7ecc28-516e-4111-ae18-8b274ea83287 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.029234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-7d4a4c89-6932-44ae-8977-95ff41075df7 req-fd7ecc28-516e-4111-ae18-8b274ea83287 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.039198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c4f9de97-302e-4e61-8b3b-6558f6530c12 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.089407 Jan 27 16:54:27.039790 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-7d4a4c89-6932-44ae-8977-95ff41075df7 req-fd7ecc28-516e-4111-ae18-8b274ea83287 service nova] Creating event network-changed:97743adb-f50c-4603-8490-a5dc53d3afb5 for instance e8c22100-7616-4a07-842e-64004815a6ca on hv-cinder-81883 Jan 27 16:54:27.040749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 466/912] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:26 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:27.045422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-7d4a4c89-6932-44ae-8977-95ff41075df7 req-fd7ecc28-516e-4111-ae18-8b274ea83287 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093830 Jan 27 16:54:27.046237 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 447/913] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:54:27.675376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:27.676257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:27.683478 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.683982 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.684773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.685215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.759230 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:27.761226 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:27.768132 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.768248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.768944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.769377 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.823380 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:27.831421 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-77b7888f-e9b6-4abb-979b-1bd0fff12814 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.159976 Jan 27 16:54:27.832031 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 467/914] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:27 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:27.836520 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:27.837131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:27.843205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.843690 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.844481 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:27.844914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:27.860325 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-74e01479-7c25-4c30-8117-cd80e31fb807 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 27821 microversion: 2.20 time: 0.105261 Jan 27 16:54:27.862196 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 448/915] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:27 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 27821 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:27.983468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:27.991132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-608abb6d-83bd-4cca-99d3-035966950887 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.157977 Jan 27 16:54:27.991709 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 468/916] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:27 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:28.051074 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:28.052090 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:28.060012 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.060456 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.061218 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.061649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.121037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-63527a9f-413f-4408-af11-a6256f3a1890 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.073835 Jan 27 16:54:28.121666 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 449/917] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:28 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:28.848219 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:28.848757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:28.855048 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.855500 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.856304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.856741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.873888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:28.874876 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:28.881575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.882017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.882791 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:28.883393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:28.965270 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c4d1a118-cd21-4590-ab4e-c490c819d109 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28189 microversion: 2.20 time: 0.096143 Jan 27 16:54:28.966059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 450/918] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:28 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28189 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:28.990873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:28.998602 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-536ca82b-ab9e-43b4-a5d8-97b0ab6a7352 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.154066 Jan 27 16:54:28.999163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 469/919] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:28 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:29.009605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:29.010419 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:29.017634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.018083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:29.018858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.019292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:29.131891 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:29.132807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:29.139054 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.139789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:29.140570 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.141006 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:29.149528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:29.158172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5789d5f4-8598-41df-9000-5bd4431d0da0 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.152637 Jan 27 16:54:29.158743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 451/920] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:29 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:29.210442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9b013d3e-05fa-43d8-8608-42083abfb977 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.082078 Jan 27 16:54:29.211203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 470/921] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:29 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:54:29.976803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:29.977721 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:29.984480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.984936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:29.985713 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:29.986151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.015792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:30.016485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:30.023234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.023702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.024541 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.024997 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.064171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f8286f86-781b-4a4f-be75-0f77aa9a0dd8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28189 microversion: 2.20 time: 0.090868 Jan 27 16:54:30.064803 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 452/922] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:29 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28189 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:30.160391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:30.168256 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1d5cdeb8-075c-452d-8ba4-c3e3a01f25c9 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.156709 Jan 27 16:54:30.168846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 471/923] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:30 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:30.183997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:30.184745 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:30.191461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.191935 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.192705 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.193138 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.221952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:30.223110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:30.230929 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.231385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.232270 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:30.232874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:30.302224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2152b09c-12e5-451b-8933-9561db44185f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.083965 Jan 27 16:54:30.302857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 472/924] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:30 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:54:30.323370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:30.331155 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-54e8499a-481c-40eb-a489-debd12ad0494 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.152112 Jan 27 16:54:30.331734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 453/925] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:30 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:31.077269 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:31.078266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.085210 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.085652 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.086429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.086924 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.170409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cbb190c8-9167-40f8-9390-3ae575db1008 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28480 microversion: 2.20 time: 0.097817 Jan 27 16:54:31.171125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 473/926] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:31 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28480 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:31.185535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:31.186283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.194369 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.194759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.195545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.196005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.314137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:31.315228 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.322166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.323352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.324324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.324854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.329514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:31.336814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-88a03543-e580-4936-9bfc-510e61bfea56 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.155619 Jan 27 16:54:31.337396 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 454/927] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:31 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:31.347287 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:31.347934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.353688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.354697 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.355492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.355959 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.387245 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fbd4eacd-4af9-48c5-ac18-be942cc355c1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.076926 Jan 27 16:54:31.387914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 474/928] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:31 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:54:31.484238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:31.491532 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6e0a8cd4-6bc9-49d3-8192-4b482b1bf4c4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1508 microversion: 2.1 time: 0.147773 Jan 27 16:54:31.492139 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 455/929] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:31 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:31.508866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:31.509516 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.516656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.517106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.517878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.518335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.699058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-61c9b462-1695-4d91-9d8a-054c07aaa994 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "POST /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343/action" status: 202 len: 0 microversion: 2.1 time: 0.193929 Jan 27 16:54:31.699872 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 475/930] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:31 2022] POST /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:31.707820 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:31.708393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:31.715142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.715618 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.716415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.716856 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.796992 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-6c3e54f6-945f-47a7-8316-fcc584988019 req-b5091af1-542e-4578-97da-f792117bf2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c459aa7-348c-4db9-97a0-5533c0d86f9a", "name": "network-vif-plugged", "status": "completed", "tag": "82a9490c-72df-4c4e-b0c6-64baab7cd6ba"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:31.798789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:31.798789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:31.813291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-6c3e54f6-945f-47a7-8316-fcc584988019 req-b5091af1-542e-4578-97da-f792117bf2c2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:31.814018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-6c3e54f6-945f-47a7-8316-fcc584988019 req-b5091af1-542e-4578-97da-f792117bf2c2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:31.839056 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-6c3e54f6-945f-47a7-8316-fcc584988019 req-b5091af1-542e-4578-97da-f792117bf2c2 service nova] Creating event network-vif-plugged:82a9490c-72df-4c4e-b0c6-64baab7cd6ba for instance 9c459aa7-348c-4db9-97a0-5533c0d86f9a on hv-cinder-81883 Jan 27 16:54:31.846604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-6c3e54f6-945f-47a7-8316-fcc584988019 req-b5091af1-542e-4578-97da-f792117bf2c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054701 Jan 27 16:54:31.847412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 476/931] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:31.895743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:31.903848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8e28ebb0-5c27-4cce-bbbe-d5bc8be955a4 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1516 microversion: 2.1 time: 0.199786 Jan 27 16:54:31.904718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 456/932] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:31 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:32.183759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:32.184738 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:32.190665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.191108 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.191898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.192329 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.335866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e5f1cae8-bc36-49f3-8433-31fe30a9e774 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28498 microversion: 2.20 time: 0.157001 Jan 27 16:54:32.336530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 477/933] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:32 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:32.353334 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:32.354514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:32.360934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.361387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.362169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.362609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.398458 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:32.399486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:32.407022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.407464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.408373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.408798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.473621 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a31ce1d8-aeec-4711-b85c-b5a952ac0ea7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.079286 Jan 27 16:54:32.474356 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 478/934] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:32 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:54:32.502738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:32.509936 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-efd80fff-4f60-4c50-ab2e-528ce0965cfb tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1315 microversion: 2.1 time: 0.160269 Jan 27 16:54:32.511002 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 457/935] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:32 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:32.921764 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:32.922497 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:32.929454 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.930124 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:32.931058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:32.931798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.075962 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:33.083193 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3b16d52f-8397-4bb9-97dd-76b33d5b6aba tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1518 microversion: 2.1 time: 0.165483 Jan 27 16:54:33.083808 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 479/936] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:32 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:33.347439 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:33.348425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:33.354700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.355267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.355918 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.356347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.448719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c65cf619-bc62-4bf1-b5f9-6568e4eabde9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28648 microversion: 2.20 time: 0.104632 Jan 27 16:54:33.449409 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 458/937] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:33 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28648 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:33.484933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:33.485938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:33.492529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.493083 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.493932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.494473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.528029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:33.528727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:33.535417 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.535893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.536663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.537089 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.557549 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-0a990305-50bb-4be9-a5eb-ef391d52d229 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.076039 Jan 27 16:54:33.558554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 480/938] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:33 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:33.669144 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:33.678717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-da6b048e-1c54-4bd1-8850-6587c05abd8f tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1464 microversion: 2.1 time: 0.155392 Jan 27 16:54:33.679486 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 459/939] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:33 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:54:33.718015 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:33.718601 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:33.725185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.725638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.726653 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.727086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.753977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:54:33.839901 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-83d8ae84-d0ab-477a-bbde-a544ddfe96f6 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 204 len: 0 microversion: 2.1 time: 0.125116 Jan 27 16:54:33.841177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 481/940] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:54:33 2022] DELETE /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:54:33.849117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:33.849736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:33.857299 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.857686 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.858480 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.858917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.862156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-82269a0f-a485-4e85-ac40-4ca13d0d2d74 req-74b9136e-d861-4f20-8c40-41b778319f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "name": "network-vif-unplugged", "status": "completed", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:33.863673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:33.863673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:33.872523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-82269a0f-a485-4e85-ac40-4ca13d0d2d74 req-74b9136e-d861-4f20-8c40-41b778319f80 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:33.872969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-82269a0f-a485-4e85-ac40-4ca13d0d2d74 req-74b9136e-d861-4f20-8c40-41b778319f80 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:33.884727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-82269a0f-a485-4e85-ac40-4ca13d0d2d74 req-74b9136e-d861-4f20-8c40-41b778319f80 service nova] Creating event network-vif-unplugged:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:54:33.890204 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-82269a0f-a485-4e85-ac40-4ca13d0d2d74 req-74b9136e-d861-4f20-8c40-41b778319f80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031989 Jan 27 16:54:33.891117 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 482/941] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:33.988993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:33.996887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-46ff723f-b313-44d4-871f-cf226b5e580b tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1470 microversion: 2.1 time: 0.151898 Jan 27 16:54:33.997853 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 460/942] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:33 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:34.101290 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:34.101988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:34.108776 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.109165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.109933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.110367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.246351 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:34.253890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-18b8554e-6382-46b9-9022-1b94367b1701 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.156976 Jan 27 16:54:34.254505 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 483/943] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:34 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:34.460252 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:34.461088 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:34.468000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.468471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.469241 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.469675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.534259 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9fea4ce4-67da-407d-8031-ff8cd334d2ad tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28648 microversion: 2.20 time: 0.077650 Jan 27 16:54:34.535170 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 461/944] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:34 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28648 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:34.567395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:34.568427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:34.575109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.575550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.576333 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:34.576764 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:34.655727 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a2a0a519-16da-49e6-bf6f-83c78e8cd7d0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.091805 Jan 27 16:54:34.656336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 484/945] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:34 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:35.016104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:35.016798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:35.023537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.024005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.024769 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.025196 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.152966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:35.160558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5547f07a-7081-44fa-853e-ad13711abe40 tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1470 microversion: 2.1 time: 0.148889 Jan 27 16:54:35.161112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 462/946] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:35 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:35.270801 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:35.271425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:35.278493 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.278944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.279749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.280189 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.412348 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:35.420318 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7d66b073-b242-4011-8169-c7881fd90fd5 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.153594 Jan 27 16:54:35.420882 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 485/947] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:35 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:35.546854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:35.548088 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:35.554176 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.554621 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.555405 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.555951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.617234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4bc41e96-8d42-4195-a10d-7c22c145fa82 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28648 microversion: 2.20 time: 0.074405 Jan 27 16:54:35.621203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 463/948] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:35 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28648 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:35.666195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:35.668237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:35.674367 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.674815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.675611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.676050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.734261 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1dbe840b-c58c-4bdb-9bed-0667c989fbde tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.071583 Jan 27 16:54:35.737393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 486/949] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:35 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:35.935215 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-727aea9a-c26b-4e83-8c46-7eb09228efff req-66fa64c6-eedc-482c-996d-26106d1002b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c459aa7-348c-4db9-97a0-5533c0d86f9a", "name": "network-vif-deleted", "tag": "82a9490c-72df-4c4e-b0c6-64baab7cd6ba"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:35.937438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:35.937438 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:54:35.946695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-727aea9a-c26b-4e83-8c46-7eb09228efff req-66fa64c6-eedc-482c-996d-26106d1002b4 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:35.947466 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-727aea9a-c26b-4e83-8c46-7eb09228efff req-66fa64c6-eedc-482c-996d-26106d1002b4 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:35.960589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-727aea9a-c26b-4e83-8c46-7eb09228efff req-66fa64c6-eedc-482c-996d-26106d1002b4 service nova] Creating event network-vif-deleted:82a9490c-72df-4c4e-b0c6-64baab7cd6ba for instance 9c459aa7-348c-4db9-97a0-5533c0d86f9a on hv-cinder-81883 Jan 27 16:54:35.965814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-727aea9a-c26b-4e83-8c46-7eb09228efff req-66fa64c6-eedc-482c-996d-26106d1002b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035846 Jan 27 16:54:35.966430 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 464/950] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:54:36.178536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:36.179119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:36.186629 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.187072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.187866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.188295 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.219094 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.219536 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.220002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lazy-loading 'fault' on Instance uuid 9c459aa7-348c-4db9-97a0-5533c0d86f9a {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:54:36.259142 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9a8702ceb614c1dbfa6d8fc2f8a8862', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7294a7a1631344cfa1e5a508f2a28289', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:36.266579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-82c1c82d-5a8a-4ef1-b56a-89ee07ca0dbc tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 200 len: 1305 microversion: 2.1 time: 0.092170 Jan 27 16:54:36.267134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 487/951] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:36 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:36.439000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:36.439648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:36.445714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.446160 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.446934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.447371 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.576536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:36.583901 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6d61b11a-fc8c-40db-a922-90cb9d555b40 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.149651 Jan 27 16:54:36.584455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 465/952] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:36 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:36.628717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:36.629640 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:36.635953 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.636404 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.637180 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.637611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.698127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e4d67db8-c53e-424d-90ec-645d7f63a2be tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 28648 microversion: 2.20 time: 0.072348 Jan 27 16:54:36.698717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 488/953] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:36 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 28648 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:36.744809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:36.745712 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:36.752234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.752679 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.753447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:36.753874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:36.812605 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8d6fa5f0-e16b-4a8f-ae42-41ba83a34ba8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.071265 Jan 27 16:54:36.813366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 466/954] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:36 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:37.283866 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:37.284565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] [instance: 9c459aa7-348c-4db9-97a0-5533c0d86f9a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:37.292033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.292487 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.293260 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.293696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.307313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] HTTP exception thrown: Instance 9c459aa7-348c-4db9-97a0-5533c0d86f9a could not be found. Jan 27 16:54:37.307917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] Returning 404 to user: Instance 9c459aa7-348c-4db9-97a0-5533c0d86f9a could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:54:37.308722 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cf9f9536-e3d6-4a01-a87d-b077d1791a5c tempest-VolumesNegativeTest-1136768334 tempest-VolumesNegativeTest-1136768334-project] 10.222.0.48 "GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a" status: 404 len: 111 microversion: 2.1 time: 0.029006 Jan 27 16:54:37.309237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 489/955] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:37 2022] GET /compute/v2.1/servers/9c459aa7-348c-4db9-97a0-5533c0d86f9a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:37.600736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:37.601434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:37.608827 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.609267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.610035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.610462 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.714049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:37.714049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:37.717707 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.718159 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.719119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.719558 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.796344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a1457044-13a9-4c1a-9a6b-3c060aaeb583 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 29999 microversion: 2.20 time: 0.089878 Jan 27 16:54:37.797303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 490/956] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:37 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 29999 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:37.824391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:37.825696 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:37.833603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.834060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.834926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:37.835372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:37.904976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3e01ec5a-1b07-4729-b118-099098a1c0ba tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.084976 Jan 27 16:54:37.905600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 491/957] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:37 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:54:37.985169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:37.992625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-eebd2503-a89c-4f71-bcda-4629e9e928c6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.395819 Jan 27 16:54:37.993273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 467/958] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:37 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:38.810002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:38.811002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:38.817882 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:38.818461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:38.819097 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:38.819529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:38.895554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fd451a8e-8698-4c74-a8cc-251cddc7631c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 31807 microversion: 2.20 time: 0.090091 Jan 27 16:54:38.897085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 492/959] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:38 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 31807 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:38.916766 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:38.917908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:38.924817 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:38.925263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:38.926031 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:38.926460 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:39.006728 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-45b355bb-ccca-4c32-b253-75c721db7c68 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.094480 Jan 27 16:54:39.009194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 468/960] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:38 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:39.010779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:39.011693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:39.022583 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:39.023944 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:39.026416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:39.027200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:39.169753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:39.177157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1839bbe0-c7a3-464a-9521-51b93ce73451 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.170876 Jan 27 16:54:39.177717 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 493/961] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:39 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:39.908555 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:39.909610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:39.916642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:39.917117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:39.917920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:39.918380 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:39.996535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d1c7f5d4-12d3-440f-8ca5-5c83acba0bbf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 33032 microversion: 2.20 time: 0.092046 Jan 27 16:54:39.997181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 469/962] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:39 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 33032 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:40.017063 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:40.017985 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:40.024343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:40.024836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:40.026405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:40.026887 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:40.090840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-006abb18-d8ea-48bc-b60f-9fcfd0ed04be tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 14 microversion: 2.1 time: 0.077596 Jan 27 16:54:40.091461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 494/963] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:40 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:54:40.194416 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:40.195037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:40.202915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:40.203365 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:40.204168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:40.204606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:40.342164 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:40.349484 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8a838c2a-ea4d-42cf-96b6-984f471bc4c9 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.159101 Jan 27 16:54:40.350051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 470/964] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:40 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:41.009501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:41.010693 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:41.018092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.018668 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.019322 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.019789 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.101280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-74882880-c93c-4c4b-a6c5-2bc0fe362238 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 33662 microversion: 2.20 time: 0.095553 Jan 27 16:54:41.101474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:41.102343 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 495/965] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:41 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 33662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:41.102482 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:41.109557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.110045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.110838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.111280 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.182720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5493158c-d8e0-4d99-907b-e8b9f46e7590 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 7059 microversion: 2.1 time: 0.084720 Jan 27 16:54:41.183503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 471/966] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:41 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 7059 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:41.366511 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:41.367235 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:41.381512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.381967 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.382751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:41.383185 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:41.527317 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:41.537469 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fdd7d50d-175e-41d9-b6be-f050549bf978 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1574 microversion: 2.1 time: 0.174832 Jan 27 16:54:41.538348 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 496/967] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:41 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:42.114847 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:42.115877 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:42.123400 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.123875 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.124654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.125086 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.194200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:42.195237 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:42.202037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.203383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.204332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.205140 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.208528 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0ec9a811-6988-4150-8dc7-cd56cc619088 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 35542 microversion: 2.20 time: 0.097023 Jan 27 16:54:42.208730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 472/968] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:42 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 35542 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:42.290564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1b8dc9a6-cfe7-447f-a595-614e9080514e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 12984 microversion: 2.1 time: 0.100366 Jan 27 16:54:42.294746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 497/969] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:42 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 12984 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:42.557231 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:42.558286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:42.565666 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.566211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.567111 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:42.567664 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:42.719425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:42.727260 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9b01eace-71e7-47c0-8a39-91f4c0124cce tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1561 microversion: 2.1 time: 0.174141 Jan 27 16:54:42.728193 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 473/970] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:54:42 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:43.220169 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:43.221950 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:43.228976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:43.229512 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:43.230369 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:43.230894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:43.302336 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:43.303265 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:43.307694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9d23d604-e9eb-4e03-a0c8-95080fe94170 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 36430 microversion: 2.20 time: 0.090759 Jan 27 16:54:43.312656 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:43.312656 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:43.313177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 498/971] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:43 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 36430 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:43.316593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:43.317620 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:43.399294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0dc8ad6c-bc38-43b0-92c9-b77fafecb84c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 17629 microversion: 2.1 time: 0.100476 Jan 27 16:54:43.401211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 474/972] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:43 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 17629 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:54:43.882156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-0139ed99-070f-4b86-94e6-3e1eb6e737c8 req-84d7c94a-35b7-4275-867b-165ae4ab5b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "name": "network-vif-plugged", "status": "completed", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:43.884072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:54:43.884072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:54:43.894126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-0139ed99-070f-4b86-94e6-3e1eb6e737c8 req-84d7c94a-35b7-4275-867b-165ae4ab5b13 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:43.894676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-0139ed99-070f-4b86-94e6-3e1eb6e737c8 req-84d7c94a-35b7-4275-867b-165ae4ab5b13 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:43.907258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-0139ed99-070f-4b86-94e6-3e1eb6e737c8 req-84d7c94a-35b7-4275-867b-165ae4ab5b13 service nova] Creating event network-vif-plugged:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:54:43.912341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-0139ed99-070f-4b86-94e6-3e1eb6e737c8 req-84d7c94a-35b7-4275-867b-165ae4ab5b13 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034400 Jan 27 16:54:43.913051 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 499/973] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:54:44.321352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:44.322751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:44.329899 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:44.330437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:44.331415 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:44.332014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:44.413836 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:44.415742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4b86e349-2c8e-4b99-bf2f-4a8fe957b440 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 37594 microversion: 2.20 time: 0.098345 Jan 27 16:54:44.417529 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 475/974] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:44 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 37594 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:44.418052 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:44.436750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:44.437200 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:44.438552 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:44.439922 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:44.518309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a7eb7114-4af7-47fd-b14d-516411c04915 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 18305 microversion: 2.1 time: 0.108773 Jan 27 16:54:44.520542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 500/975] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:44 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 18305 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:45.430625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:45.431946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:45.438874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:45.439319 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:45.440119 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:45.440550 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:45.532441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d2c7f6bb-4533-44ad-987e-184227630912 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 38199 microversion: 2.20 time: 0.104560 Jan 27 16:54:45.536782 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 476/976] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:45 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 38199 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:45.537181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:45.537181 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:45.542590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:45.543297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:45.544280 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:45.544868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:45.630314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e24acb0a-78a2-4fdf-a250-5a41bfa5d688 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 20074 microversion: 2.1 time: 0.103456 Jan 27 16:54:45.631719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 501/977] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:45 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 20074 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:54:46.544665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:46.545674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:46.552774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:46.553448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:46.554291 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:46.554672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:46.619874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-273a046f-153b-41c5-97e5-bde2257788eb tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 38199 microversion: 2.20 time: 0.079146 Jan 27 16:54:46.624187 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 477/978] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:46 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 38199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:46.643378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:46.645165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:46.653573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:46.654027 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:46.654851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:46.655385 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:46.734048 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-824c420f-16b1-4530-8297-e1a7a1f5392d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 22217 microversion: 2.1 time: 0.094810 Jan 27 16:54:46.734679 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 502/979] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:46 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 22217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:47.632849 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:47.634210 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:47.641272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:47.641742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:47.642747 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:47.643179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:47.716247 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2e416a0a-5c6d-4af3-a4ec-cc30e3d8ff38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 38199 microversion: 2.20 time: 0.087224 Jan 27 16:54:47.718046 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 478/980] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:47 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 38199 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:47.752013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:47.755131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:47.765135 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:47.765896 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:47.766874 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:47.767459 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:47.849586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1274a751-5abf-4184-99e5-85e0d6c187ce tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 23802 microversion: 2.1 time: 0.105978 Jan 27 16:54:47.850445 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 503/981] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:47 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 23802 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:48.735423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:48.736798 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:48.744159 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:48.744625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:48.745429 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:48.745920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:48.833506 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-045bbd2b-6805-4e89-9f72-1010ebc5731f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 38199 microversion: 2.20 time: 0.108078 Jan 27 16:54:48.834174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 479/982] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:48 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 38199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 27 16:54:48.862848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:48.863943 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:48.874605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:48.875272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:48.878127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:48.878643 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:48.979074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-50f9d82d-d34d-417e-a6d4-21f1c73bbec8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 25227 microversion: 2.1 time: 0.120404 Jan 27 16:54:48.980401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 504/983] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:48 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 25227 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:49.846162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:49.848255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:49.896447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:49.898179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:49.905704 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:49.906535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:49.990947 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:49.991895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:49.998742 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:49.999413 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:50.000401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:50.001047 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:50.010879 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c4a01bff-a68f-40cc-8a06-740bd310812e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 200 len: 38340 microversion: 2.20 time: 0.168037 Jan 27 16:54:50.012152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 480/984] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:49 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 38340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:54:50.022395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:50.023137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:50.037181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:50.041521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:50.042562 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:50.043151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:50.087037 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-13ecd936-42b3-4430-82d3-30b76b142335 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/ips" status: 200 len: 151 microversion: 2.20 time: 0.068798 Jan 27 16:54:50.088552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 481/985] 10.222.0.48 () {60 vars in 1288 bytes} [Thu Jan 27 16:54:50 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:54:50.142080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-26803c97-2024-4c94-b96c-c8add08c66a7 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 26569 microversion: 2.1 time: 0.140007 Jan 27 16:54:50.143918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 505/986] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:49 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 26569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:54:51.154091 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:51.162337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:51.172511 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:51.172968 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:51.173770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:51.174207 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:51.304359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4b2fbcf5-1a98-4a0b-80b8-f256d8f00cd0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 27427 microversion: 2.1 time: 0.153763 Jan 27 16:54:51.305663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 482/987] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:51 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 27427 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:51.886466 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Action: 'create', calling method: .version_select at 0x7f0cf04e7dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-699219578"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:51.901773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:51.906683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for user 6bf586d36da74c29ab1a188bb6da8603 and project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:52.185766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:54:52.189408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for user 6bf586d36da74c29ab1a188bb6da8603 and project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'key_pairs'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:54:52.203336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-35800e86-47a1-47e8-9edf-26f4aa50eb4d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.496729 Jan 27 16:54:52.203969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 506/988] 10.222.0.48 () {60 vars in 1157 bytes} [Thu Jan 27 16:54:51 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:54:52.317640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:52.318642 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:52.326519 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.326970 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:52.328916 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.328916 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:52.422920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:52.423686 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:52.430211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-051d2c0b-8af8-42c1-81c5-8453b5c767ed tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 27771 microversion: 2.1 time: 0.115959 Jan 27 16:54:52.432014 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 483/989] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:52 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 27771 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:52.443133 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.443829 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:52.444767 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.447644 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:52.479946 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lazy-loading 'flavor' on Instance uuid 094ca1ee-6735-4773-88c3-f81551f79fec {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:54:52.839879 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4ec6c994-3a7b-409a-88b5-8831425018a6 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 202 len: 0 microversion: 2.20 time: 0.420488 Jan 27 16:54:52.840604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 507/990] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:54:52 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:54:52.848845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:52.849841 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:52.857739 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.858613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:52.859913 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:52.860719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:53.070392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:53.084033 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:53.090783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:53.092644 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b41dea10-6450-481e-ae00-3f2b0e378d84 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.247691 Jan 27 16:54:53.093649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 484/991] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:52 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:53.445960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:53.447920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:53.456772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:53.457627 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:53.458399 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:53.458846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:53.555297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-bdb086c7-9e58-4691-85d9-29449d2bfeca tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28138 microversion: 2.1 time: 0.115880 Jan 27 16:54:53.556524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 508/992] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:53 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28138 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:54.114041 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:54.114652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:54.121190 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:54.121634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:54.122612 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:54.123049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:54.280985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:54.289045 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:54.291341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:54.292578 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-54ec858e-b9b4-46b0-9447-316d80cc8c75 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.182200 Jan 27 16:54:54.295348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 485/993] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:54 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:54.568033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:54.569182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:54.576958 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:54.577486 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:54.578348 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:54.578862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:54.672220 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d123091f-5d69-47ab-8324-3d86908a891f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28200 microversion: 2.1 time: 0.108065 Jan 27 16:54:54.676126 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 509/994] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:54 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28200 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:55.313904 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:55.314703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:55.321034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:55.322115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:55.322965 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:55.323401 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:55.480483 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:55.491066 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:55.493664 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:55.495825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9d770353-8be2-47c3-bdf4-2b37d2b70840 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.185338 Jan 27 16:54:55.496769 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 486/995] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:55 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:55.684603 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:55.685520 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:55.692428 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:55.692880 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:55.693654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:55.694096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:55.771845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a1dcf05a-8fe7-4ec0-b5eb-9251909720d2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28200 microversion: 2.1 time: 0.091330 Jan 27 16:54:55.772491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 510/996] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:55 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:56.517391 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:56.517999 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:56.524355 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:56.525376 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:56.526151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:56.526572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:56.654619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:56.662272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:56.663780 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:56.664989 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fac1ab06-19ac-43b8-80fb-9f6444db191a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.151573 Jan 27 16:54:56.665555 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 487/997] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:56 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:56.784954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:56.785973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:56.793979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:56.794431 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:56.795236 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:56.795710 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:56.889230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d64950d5-4f8a-4de6-887f-b403e215c5bd tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28487 microversion: 2.1 time: 0.107916 Jan 27 16:54:56.889839 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 511/998] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:56 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28487 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:57.682048 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:57.682654 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:57.688925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:57.689368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:57.690126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:57.690558 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:57.820387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:57.828648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:57.830134 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:57.831298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1f9e536c-b9ef-4e45-b153-bf2f1fa1fba9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.153006 Jan 27 16:54:57.831888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 488/999] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:57 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:57.901404 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:57.902433 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:57.909206 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:57.909655 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:57.910434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:57.910868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:57.982391 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3e8b3cd0-30e7-48f7-9554-b66de996d285 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28487 microversion: 2.1 time: 0.085385 Jan 27 16:54:57.983032 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 512/1000] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:57 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28487 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:54:58.849973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:54:58.850497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:58.857211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:58.857659 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:58.858451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:58.858886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:58.993424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:58.995408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:54:58.996457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:54:59.002323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:59.003258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:59.003737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:59.003941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:54:59.004611 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:54:59.005053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:54:59.005370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9fac79b8-d986-4330-bad9-eae0108bc2b4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.159249 Jan 27 16:54:59.005931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 489/1001] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:54:58 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:54:59.084772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4b9e9893-2e13-4012-97ec-955fc7384927 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28655 microversion: 2.1 time: 0.094214 Jan 27 16:54:59.085394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 513/1002] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:54:58 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:00.023472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:00.024115 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:00.030734 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.031181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.031987 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.032422 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.097822 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:00.098824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:00.106640 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.107092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.107910 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.108352 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.161337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:00.169822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:00.171289 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:00.172536 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-19964e5d-630d-4a01-9f01-e786b12ebe38 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.152796 Jan 27 16:55:00.182009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 490/1003] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:00 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:00.182195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1d1d99a5-4ae4-47de-8b7d-1fe10a192b33 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28655 microversion: 2.1 time: 0.083415 Jan 27 16:55:00.182195 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 514/1004] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:00 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28655 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:55:00.182350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-84671400"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:00.182350 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:00.185765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.186207 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.186973 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.187402 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.322310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.network.security_group_api [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Removing security group 916d14d8-7f52-490d-840a-6eda3f112a25 from port bdf14445-13aa-42c8-8538-0e113ea22eb2 Jan 27 16:55:00.657955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dcb89450-0a99-4e04-8d3a-357eac3ef8c9 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action" status: 202 len: 0 microversion: 2.1 time: 0.482961 Jan 27 16:55:00.661910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 491/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:00 2022] POST /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:00.672246 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-db016099-9f66-4fe6-9cd8-82fd723c3b74 req-0ffe23de-9244-490a-bb45-0c597401cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:00.674251 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:00.674251 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:55:00.684139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-db016099-9f66-4fe6-9cd8-82fd723c3b74 req-0ffe23de-9244-490a-bb45-0c597401cd92 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:00.684888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-db016099-9f66-4fe6-9cd8-82fd723c3b74 req-0ffe23de-9244-490a-bb45-0c597401cd92 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:00.712400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-db016099-9f66-4fe6-9cd8-82fd723c3b74 req-0ffe23de-9244-490a-bb45-0c597401cd92 service nova] Creating event network-changed:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:55:00.719998 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-db016099-9f66-4fe6-9cd8-82fd723c3b74 req-0ffe23de-9244-490a-bb45-0c597401cd92 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054283 Jan 27 16:55:00.720800 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 515/1006] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:01.192463 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:01.193116 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:01.194502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:01.196842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:01.203217 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:01.203971 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:01.204429 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:01.204705 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:01.205345 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:01.205778 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:01.206386 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:01.207044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:01.299129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-af68557d-d282-4974-8ee9-c7fdf12b34a2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28655 microversion: 2.1 time: 0.113296 Jan 27 16:55:01.300690 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 492/1007] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:01 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:01.408429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:01.416955 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:01.418457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:01.419667 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6e339a8f-6e71-4362-84de-ffd143333898 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.231221 Jan 27 16:55:01.420230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 516/1008] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:01 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:02.117894 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:02.119681 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:02.131806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.132510 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.133954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.135179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.215356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lazy-loading 'services' on Instance uuid 2a8d6efb-9e26-48f5-80a7-4447209ea47e {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:55:02.287726 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ed1239ff-876c-43db-81a7-1cf82782832a tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments/f36a3758-1924-416b-bc7d-027e79683d62" status: 202 len: 0 microversion: 2.1 time: 0.174513 Jan 27 16:55:02.288601 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 493/1009] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:55:02 2022] DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments/f36a3758-1924-416b-bc7d-027e79683d62 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:02.297604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:02.299176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:02.306607 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.307442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.308846 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.309609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.329951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:02.331212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:02.341449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.342282 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.343296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.344069 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.365920 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-172e0950-67f2-4f41-8f73-97623552ee50 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072258 Jan 27 16:55:02.370556 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 517/1010] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:02 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:02.425944 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d9dd2f21-329f-4382-b1c5-8f4bcc37ae0c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28655 microversion: 2.1 time: 0.117312 Jan 27 16:55:02.427097 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 494/1011] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:02 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28655 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:02.437592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:02.438311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:02.444338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.444865 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.445751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.446252 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.592044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:02.602495 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:02.604704 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:02.605891 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b4919ff3-cc93-44fc-b643-1f5e9cfa09a3 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.172059 Jan 27 16:55:02.606453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 518/1012] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:02 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:02.735293 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-81e6ddd6-8ec8-41fb-9a71-8b9804340c4b req-eb9bfbe7-088b-489c-9ef6-7fc855bdc8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:02.737121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:02.737121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:02.747845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-81e6ddd6-8ec8-41fb-9a71-8b9804340c4b req-eb9bfbe7-088b-489c-9ef6-7fc855bdc8e3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:02.748373 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-81e6ddd6-8ec8-41fb-9a71-8b9804340c4b req-eb9bfbe7-088b-489c-9ef6-7fc855bdc8e3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:02.761767 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-81e6ddd6-8ec8-41fb-9a71-8b9804340c4b req-eb9bfbe7-088b-489c-9ef6-7fc855bdc8e3 service nova] Creating event network-changed:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:55:02.769007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-81e6ddd6-8ec8-41fb-9a71-8b9804340c4b req-eb9bfbe7-088b-489c-9ef6-7fc855bdc8e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037817 Jan 27 16:55:02.769885 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 495/1013] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:03.377861 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:03.378792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:03.385634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.386093 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.386892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.387331 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.417772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-30ab4993-59fe-4cb6-a3d7-789d1923e886 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043636 Jan 27 16:55:03.418340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 519/1014] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:03 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:55:03.428616 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:03.429197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:03.436273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.436720 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.437452 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:03.437567 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.437930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.438365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:03.444145 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.444600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.445404 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.445845 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.511389 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] HTTP exception thrown: Instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e is not attached to volume f36a3758-1924-416b-bc7d-027e79683d62 Jan 27 16:55:03.512124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Returning 404 to user: Instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e is not attached to volume f36a3758-1924-416b-bc7d-027e79683d62 {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:03.512956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6afeb569-8d0d-4bf6-a7d7-e391e8464f70 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments/f36a3758-1924-416b-bc7d-027e79683d62" status: 404 len: 154 microversion: 2.1 time: 0.088566 Jan 27 16:55:03.513761 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 496/1015] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:55:03 2022] DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e/os-volume_attachments/f36a3758-1924-416b-bc7d-027e79683d62 => generated 154 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:03.513917 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b6d227b1-f260-4526-a77a-ab376d299390 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28655 microversion: 2.1 time: 0.079486 Jan 27 16:55:03.515424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 520/1016] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:03 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28655 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:55:03.624079 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:03.624682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:03.630993 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.631434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.632232 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:03.632664 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:03.767360 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:03.775001 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:03.776535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:03.777730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d5560b26-5d1a-416f-b9d1-27cba0462458 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.157428 Jan 27 16:55:03.778278 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 497/1017] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:03 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:04.526633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:04.527658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:04.534465 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.534919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.535729 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.536168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.632424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2ce53541-657f-4873-b62e-34b1c00b3a58 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 28985 microversion: 2.1 time: 0.109632 Jan 27 16:55:04.637326 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 521/1018] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:04 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 28985 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:04.649569 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:04.651030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:04.657920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.658474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.659972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.660611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.688814 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:55:04.768826 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-762bd4bb-72de-43fc-b5e0-6b8743a62412 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 204 len: 0 microversion: 2.1 time: 0.122717 Jan 27 16:55:04.769482 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 498/1019] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:55:04 2022] DELETE /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:55:04.778416 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:04.779165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:04.786113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.786561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.787332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.787798 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.795684 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:04.796395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:04.802343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.802785 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:04.803607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:04.804040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:05.003441 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:05.006759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:05.011891 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:05.013633 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:05.014828 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d583118f-7444-4cbd-8ff3-2e4a8a356ae8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.223207 Jan 27 16:55:05.015045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ad608ef6-f45a-4d4d-a90f-70bff16d64b1 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1555 microversion: 2.1 time: 0.241180 Jan 27 16:55:05.015392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 499/1020] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:04 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:05.015615 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 522/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:04 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1555 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:05.644758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:05.645602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:05.651995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:05.652541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:05.653206 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:05.653640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:05.733253 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2b79b9d4-a437-4f90-a3ac-fcbb572aa051 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 30153 microversion: 2.1 time: 0.092037 Jan 27 16:55:05.733882 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 500/1022] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:05 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 30153 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:06.031456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:06.032102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:06.033711 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:06.034437 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:06.038589 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.039042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.039843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.040281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.041364 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.041820 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.042602 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.043040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.232263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:06.235231 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:06.239723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-038be9bd-2754-49b4-8c72-ef87872b3386 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1555 microversion: 2.1 time: 0.211881 Jan 27 16:55:06.240299 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 523/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:06 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:06.243873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:06.245398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:06.246556 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9431e2c1-2c4b-4111-894d-9a19414ea5c2 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.216872 Jan 27 16:55:06.247098 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 501/1024] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:06 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:06.744750 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:06.745664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:06.751938 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.752393 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.753171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:06.753604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:06.839117 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d7ee2c96-37af-447b-9285-94016de7401c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 31304 microversion: 2.1 time: 0.097801 Jan 27 16:55:06.843047 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 524/1025] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:06 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 31304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:07.164781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-9b817eba-9f24-4d92-af99-7d196f7e7780 req-7b95368c-9e58-4123-874e-a1be8f5114a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a8d6efb-9e26-48f5-80a7-4447209ea47e", "name": "network-vif-deleted", "tag": "bdf14445-13aa-42c8-8538-0e113ea22eb2"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:07.166388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:07.166388 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:07.174449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-9b817eba-9f24-4d92-af99-7d196f7e7780 req-7b95368c-9e58-4123-874e-a1be8f5114a4 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.174890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-9b817eba-9f24-4d92-af99-7d196f7e7780 req-7b95368c-9e58-4123-874e-a1be8f5114a4 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.186850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-9b817eba-9f24-4d92-af99-7d196f7e7780 req-7b95368c-9e58-4123-874e-a1be8f5114a4 service nova] Creating event network-vif-deleted:bdf14445-13aa-42c8-8538-0e113ea22eb2 for instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e on hv-cinder-81883 Jan 27 16:55:07.192375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-9b817eba-9f24-4d92-af99-7d196f7e7780 req-7b95368c-9e58-4123-874e-a1be8f5114a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Jan 27 16:55:07.192952 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 502/1026] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:07.256905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:07.257646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:07.265824 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.266073 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:07.266273 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.266655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:07.267060 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.267496 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.273929 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.274376 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.275158 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.275702 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.300830 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.301264 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.301723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lazy-loading 'fault' on Instance uuid 2a8d6efb-9e26-48f5-80a7-4447209ea47e {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:55:07.359835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f949c79110dd4ceaa532c18230e00a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe08ade68b284511b92c42fba70f29d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:07.367141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8b809e54-5482-41b6-a9df-83c8e1004156 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 200 len: 1348 microversion: 2.1 time: 0.114320 Jan 27 16:55:07.367738 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 525/1027] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:07 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:07.428534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:07.437444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:07.438982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:07.440259 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8e33bea4-ae2a-4128-8fa1-555f201d344e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.178782 Jan 27 16:55:07.440821 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 503/1028] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:07 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:07.850072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:07.850991 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:07.857524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.857971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.858748 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:07.859186 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:07.948905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b6c5fe46-efe0-40f3-b4a0-2a477f2530bf tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 32404 microversion: 2.1 time: 0.102238 Jan 27 16:55:07.949457 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 526/1029] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:07 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 32404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:08.384563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:08.385173 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] [instance: 2a8d6efb-9e26-48f5-80a7-4447209ea47e] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:08.391655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.392107 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:08.392876 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.393311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:08.406117 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] HTTP exception thrown: Instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e could not be found. Jan 27 16:55:08.406682 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Returning 404 to user: Instance 2a8d6efb-9e26-48f5-80a7-4447209ea47e could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:08.407474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-48ec86cd-fb0e-4285-8e73-eb4f2980fd3f tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e" status: 404 len: 111 microversion: 2.1 time: 0.026723 Jan 27 16:55:08.408016 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 504/1030] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:08 2022] GET /compute/v2.1/servers/2a8d6efb-9e26-48f5-80a7-4447209ea47e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:08.416999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ed90cc55-1718-4b02-bb2c-d4c357cf05f8 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] Calling method '.version_select at 0x7f0cf07f1790>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:08.437526 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ed90cc55-1718-4b02-bb2c-d4c357cf05f8 tempest-TestMinimumBasicScenario-220738497 tempest-TestMinimumBasicScenario-220738497-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-167211131" status: 202 len: 0 microversion: 2.1 time: 0.025059 Jan 27 16:55:08.438076 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 527/1031] 10.222.0.48 () {58 vars in 1268 bytes} [Thu Jan 27 16:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-167211131 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:08.460572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:08.461121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:08.467181 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.467652 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:08.468923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.468923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:08.609174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:08.618447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:08.620443 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:08.621635 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d9e3979b-0856-49c5-b0f9-aad3bdc7748a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.166637 Jan 27 16:55:08.622531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 505/1032] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:08 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:08.960564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:08.961614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:08.969024 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.969471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:08.970244 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:08.970673 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:09.046506 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a64200d7-ca0f-4a6d-88c9-24d35b716128 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 33077 microversion: 2.1 time: 0.089496 Jan 27 16:55:09.047163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 528/1033] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:08 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 33077 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:09.641114 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:09.641887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:09.648688 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:09.649170 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:09.650240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:09.650747 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:09.805458 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1730565197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-699219578", "security_groups": [{"name": "tempest-secgroup-smoke-962365757"}], "block_device_mapping_v2": [{"uuid": "72aa3567-4f05-497a-8d1d-07d25f9e4544", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31086914-ef67-4638-ab4e-856fdab7280e"}]}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:09.872440 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:09.898179 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:09.900845 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:09.902040 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-243a71f4-d538-4ebd-921c-f3b34c8095a0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1742 microversion: 2.20 time: 0.265445 Jan 27 16:55:09.902591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 506/1034] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:09 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1742 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:09.974672 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.network.neutron [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] validate_networks() for [('31086914-ef67-4638-ab4e-856fdab7280e', None, None, None, None, None)] {{(pid=127796) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:55:10.059147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:10.060453 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:10.066264 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.066811 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.068595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.069593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.155749 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c7fb0821-5d1c-43c2-bde3-53057dad096d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 34069 microversion: 2.1 time: 0.100258 Jan 27 16:55:10.159920 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 507/1035] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:10 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 34069 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:55:10.655878 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:55:10.656297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image limits 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:55:10.656758 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:55:10.657247 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image pref 0:0:0 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:55:10.657652 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.virt.hardware [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127796) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:55:10.666384 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.666772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.667628 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.668067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.684960 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:55:10.689138 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.quota [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for user 6bf586d36da74c29ab1a188bb6da8603 and project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127796) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:55:10.744777 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Going to run 1 instances... {{(pid=127796) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:55:10.746966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72aa3567-4f05-497a-8d1d-07d25f9e4544',volume_size=None,volume_type=None)] {{(pid=127796) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:55:10.881859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d5100e2a-5a28-4fc3-a5a9-fe9a21297ab0 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.080399 Jan 27 16:55:10.882554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 529/1036] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:55:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 27 16:55:10.893691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9c109d19-b460-43f3-ab9e-aa6f1731ddbd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:10.895009 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9c109d19-b460-43f3-ab9e-aa6f1731ddbd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:10.921823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:10.921823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:10.928576 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.929756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.931460 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:10.932080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:10.985125 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9c109d19-b460-43f3-ab9e-aa6f1731ddbd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:10.994283 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9c109d19-b460-43f3-ab9e-aa6f1731ddbd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1094 microversion: 2.1 time: 0.103700 Jan 27 16:55:10.994961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 508/1037] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:10 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1094 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:11.169833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:11.171150 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:11.178793 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:11.179610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:11.180986 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:11.181695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:11.289731 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-58386480-4dee-4e7d-8641-41574150b3e4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 35073 microversion: 2.1 time: 0.125130 Jan 27 16:55:11.292077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 509/1038] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:11 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 35073 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:55:11.429332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:11.439030 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:11.440694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:11.441951 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ec372181-b70d-43eb-b261-878f84c0e61e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1742 microversion: 2.20 time: 0.525346 Jan 27 16:55:11.442584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 530/1039] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:10 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1742 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:12.010285 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d0cee288-9cc6-4901-a31d-7cfc814d7ff5 req-4beb7d80-9dff-4518-bbe6-99456dbae11f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "name": "network-vif-plugged", "status": "completed", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:12.012033 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:12.013474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:12.013969 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:12.013969 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:12.025902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0cee288-9cc6-4901-a31d-7cfc814d7ff5 req-4beb7d80-9dff-4518-bbe6-99456dbae11f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.026762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d0cee288-9cc6-4901-a31d-7cfc814d7ff5 req-4beb7d80-9dff-4518-bbe6-99456dbae11f service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.041120 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.042725 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d0cee288-9cc6-4901-a31d-7cfc814d7ff5 req-4beb7d80-9dff-4518-bbe6-99456dbae11f service nova] Creating event network-vif-plugged:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:55:12.048103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d0cee288-9cc6-4901-a31d-7cfc814d7ff5 req-4beb7d80-9dff-4518-bbe6-99456dbae11f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048419 Jan 27 16:55:12.049453 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 510/1040] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:12.050129 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.051131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.052864 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.236122 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:12.248551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ff7705d9-183c-47be-a961-c34411294c5b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1200 microversion: 2.1 time: 0.241812 Jan 27 16:55:12.252179 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 531/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:12 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1200 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:55:12.304804 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:12.306800 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:12.313603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.314378 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.315366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.315802 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.419328 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cf9580ce-5113-4262-b0e2-2f73c0e82c74 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 36102 microversion: 2.1 time: 0.119548 Jan 27 16:55:12.420627 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 511/1042] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:12 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 36102 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:12.464157 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:12.465973 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:12.473008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.473563 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.477209 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:12.478037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:12.753869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:12.776670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:12.778760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:12.780634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e071036f-c5f3-4976-9a2f-01b17b51878c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.323068 Jan 27 16:55:12.794055 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 532/1043] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:12 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:13.268641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:13.270202 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:13.288590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.289773 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:13.291124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.291949 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:13.406049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:13.433172 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:13.434155 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:13.439347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-72e200a1-2ac2-48d6-ae03-e7027e18a81b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1198 microversion: 2.1 time: 0.175534 Jan 27 16:55:13.443243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.455719 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:13.456662 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 512/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:13 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1198 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:13.465575 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.466188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:13.621308 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-d03d92ab-f212-4276-a388-96884adc6c6e tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 37525 microversion: 2.1 time: 0.192551 Jan 27 16:55:13.625464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 533/1045] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:13 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 37525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 27 16:55:13.799425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:13.803457 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:13.812387 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.813408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:13.814695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:13.815475 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:14.021823 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:14.034671 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:14.037495 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:14.041288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bbeb9127-e0d2-4d88-925f-274dbd7deae0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.245659 Jan 27 16:55:14.042503 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 513/1046] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:13 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:14.460272 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:14.460964 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:14.470758 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:14.476565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:14.477447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:14.478073 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:14.640595 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:14.641423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:14.663590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:14.664059 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:14.665641 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:14.669603 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:14.736916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:14.747624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-23fc82a2-9094-48d3-aba1-810a3d026f88 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.290989 Jan 27 16:55:14.751425 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 534/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:14 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:14.785090 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-92844350-2fdb-4951-af4c-a8c984e4caf2 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.148470 Jan 27 16:55:14.795000 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 514/1048] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:14 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 38178 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:15.060378 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:15.061578 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:15.079075 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-f4603b7a-a167-46fb-8c44-03deb280df07 req-6cfeaedb-8179-45ce-8dac-820d6d4a648b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76bd5f8-b0be-4230-8011-a683fcb41d21", "tag": "ddb0a081-44ae-4078-a6e3-6ef517eaaabd"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:15.080946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:15.080946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:15.112106 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.115476 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.117177 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.117813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.132466 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-f4603b7a-a167-46fb-8c44-03deb280df07 req-6cfeaedb-8179-45ce-8dac-820d6d4a648b service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.133116 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-f4603b7a-a167-46fb-8c44-03deb280df07 req-6cfeaedb-8179-45ce-8dac-820d6d4a648b service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.153504 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-f4603b7a-a167-46fb-8c44-03deb280df07 req-6cfeaedb-8179-45ce-8dac-820d6d4a648b service nova] Creating event network-changed:ddb0a081-44ae-4078-a6e3-6ef517eaaabd for instance e76bd5f8-b0be-4230-8011-a683fcb41d21 on hv-cinder-81883 Jan 27 16:55:15.159123 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-f4603b7a-a167-46fb-8c44-03deb280df07 req-6cfeaedb-8179-45ce-8dac-820d6d4a648b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087760 Jan 27 16:55:15.161242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 515/1049] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:55:15.376584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:15.384877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:15.386372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:15.387550 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e8a5c00f-1191-42b6-b878-47c9cb12f57e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.332048 Jan 27 16:55:15.394358 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 535/1050] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:15 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:15.768398 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:15.769101 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:15.785351 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.786032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.788559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.789163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.806676 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:15.807961 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:15.828182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.831927 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.834096 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:15.834646 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:15.924895 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f1721ba7-6f3b-49d9-9de9-be6a6e28599d tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.122869 Jan 27 16:55:15.926319 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 536/1051] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:15 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 38178 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:16.252901 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:16.261104 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-306896d0-f0b4-4f29-815b-d48add25c457 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.497370 Jan 27 16:55:16.265992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 516/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:15 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:16.418408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:16.419192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:16.426395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:16.427013 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:16.427928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:16.428372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:16.622803 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:16.631852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:16.633347 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:16.635089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-73578fd4-7a1b-431c-b78e-88e5cfbcc13a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.224528 Jan 27 16:55:16.637936 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 537/1053] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:16 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:16.941492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:16.941492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:16.949813 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:16.950267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:16.951700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:16.952425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:17.022594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-849b51ac-e78b-41d9-9d23-4072a6b4c57a tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 38178 microversion: 2.1 time: 0.088172 Jan 27 16:55:17.023267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 517/1054] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:16 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 38178 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:17.282996 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:17.284327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:17.294035 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:17.294883 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:17.295996 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:17.296654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:17.469756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:17.480131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1e716987-ff1e-43cc-9750-b12b88234871 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.201255 Jan 27 16:55:17.481274 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 538/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:17 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:17.654857 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:17.655854 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:17.662703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:17.663151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:17.663955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:17.664549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:18.035488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:18.037867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:18.053654 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:18.055854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:18.058862 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:18.059555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:18.121296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:18.138230 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:18.141674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:18.143146 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8fd1449f-b037-4388-8c20-d796a9b3dcc0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.492735 Jan 27 16:55:18.144113 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 518/1056] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:17 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:18.174394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-cab4e6ab-1fa5-4b40-ba4a-5de1294a05b3 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 38195 microversion: 2.1 time: 0.143537 Jan 27 16:55:18.179617 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 539/1057] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:18 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 38195 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:18.497491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:18.499242 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:18.515030 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:18.517257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:18.518305 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:18.519746 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:18.764229 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:18.772348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-55872ef6-f5a6-48f5-abd8-ca15bdb4bb51 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.279423 Jan 27 16:55:18.773153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 519/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:18 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:19.162852 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:19.163637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:19.186860 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:19.188423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:19.198751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.201537 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.202198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.203171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.204052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.204456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.205405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.209555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.299874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-86c05c0a-6100-444f-b553-8d12eb3c8ff8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action" status: 200 len: 38307 microversion: 2.1 time: 0.116426 Jan 27 16:55:19.300541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 520/1059] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Jan 27 16:55:19 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/action => generated 38307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:19.315163 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:19.316008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:19.328129 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.333203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.335257 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.338866 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.392053 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8254a3b4-ec6f-4734-97c0-aa01aa764ec0 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/ips" status: 200 len: 144 microversion: 2.1 time: 0.083737 Jan 27 16:55:19.395985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 521/1060] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:55:19 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/ips => generated 144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:55:19.484502 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:19.493000 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:19.495353 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:19.497102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-26089246-b224-4d85-af73-5cfb26c9e2e8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.339041 Jan 27 16:55:19.498174 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 540/1061] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:19 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:19.789352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:19.790165 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:19.798225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.798992 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:19.799972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:19.800552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:20.022054 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:20.033520 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8e12d8d0-0c49-4b43-957d-1f935f254b29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.247810 Jan 27 16:55:20.034017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 522/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:19 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:20.520276 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:20.520889 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:20.528355 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:20.528800 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:20.529574 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:20.529999 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:20.677325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:20.685701 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:20.688102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:20.689468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c49871bb-78d9-4740-abb3-cc9e24cc164d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.172981 Jan 27 16:55:20.690514 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 541/1063] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:20 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:20.856824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fe3382f-38e2-4199-a3cf-90472479210a"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:20.857902 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:20.864032 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:20.864474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:20.865255 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:20.865689 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:21.050907 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:21.051534 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:21.060249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:21.061364 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:21.062229 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:21.062711 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:21.140234 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2ffeae3c-ddb1-46c4-827c-4861db339bd4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287654 Jan 27 16:55:21.146305 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 523/1064] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:55:20 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:21.253969 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:21.263954 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-58df2d78-86f2-4426-8bd2-8663d77281a1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.216151 Jan 27 16:55:21.274079 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 542/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:21 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:21.709411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:21.710198 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:21.720900 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:21.721346 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:21.722127 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:21.722619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:21.879035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:21.891888 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:21.893597 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:21.894946 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3bc85bc1-d2cc-407c-b3da-167170d35c87 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.190449 Jan 27 16:55:21.895743 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 524/1066] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:21 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:22.280563 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:22.281182 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:22.287754 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:22.288281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:22.289338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:22.290116 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:22.434132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:22.442759 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f5b38679-d37b-4071-ab3b-d8f19b7fc435 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.165724 Jan 27 16:55:22.443341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 543/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:22 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:22.913629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:22.914607 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:22.921479 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:22.922055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:22.922956 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:22.923492 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:23.070546 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:23.079468 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:23.080972 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:23.082183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-1c53ae3a-d0a8-48f9-9c93-20ea07f80a42 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.172438 Jan 27 16:55:23.082747 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 525/1068] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:22 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:23.458987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:23.460207 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:23.467877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:23.468546 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:23.469564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:23.469993 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:23.611892 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:23.620440 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-37a3ccea-b2de-4fa0-9327-83983173b733 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.164979 Jan 27 16:55:23.629490 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 544/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:23 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:24.101332 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:24.102083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:24.108088 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:24.108538 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:24.109320 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:24.109755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:24.240781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:24.248500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:24.249997 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:24.251333 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c26a3268-8c3e-4bb4-b2d8-fab16f8480bf tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1737 microversion: 2.20 time: 0.154084 Jan 27 16:55:24.251941 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 526/1070] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:24 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:24.637792 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:24.638568 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:24.645453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:24.646008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:24.646893 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:24.647407 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:24.782049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:24.789227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-13f74323-bcae-4a16-917d-b972cfff2f38 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.155977 Jan 27 16:55:24.790405 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 545/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:24 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:25.270411 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:25.270954 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:25.277651 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:25.278095 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:25.278863 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:25.279297 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:25.406960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:25.415299 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:25.416829 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:25.417988 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-c4ec9fab-0057-4cff-a5f3-234eb67125a9 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1719 microversion: 2.20 time: 0.151362 Jan 27 16:55:25.418539 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 527/1072] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:25 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:25.806757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:25.807289 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:25.813634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:25.814092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:25.814869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:25.815309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:25.948434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:25.956163 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e8b4a120-2685-4765-8796-f137c7155157 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.153780 Jan 27 16:55:25.956749 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 546/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:25 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:26.061085 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-6296f2cf-4416-4313-b7ff-ecae7a3959b4 req-3b80710f-1c78-4bac-950d-9c287b0639fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76bd5f8-b0be-4230-8011-a683fcb41d21", "name": "network-vif-plugged", "status": "completed", "tag": "ddb0a081-44ae-4078-a6e3-6ef517eaaabd"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:26.062724 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:26.062724 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:26.070276 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-6296f2cf-4416-4313-b7ff-ecae7a3959b4 req-3b80710f-1c78-4bac-950d-9c287b0639fa service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:26.071294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-6296f2cf-4416-4313-b7ff-ecae7a3959b4 req-3b80710f-1c78-4bac-950d-9c287b0639fa service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:26.084238 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-6296f2cf-4416-4313-b7ff-ecae7a3959b4 req-3b80710f-1c78-4bac-950d-9c287b0639fa service nova] Creating event network-vif-plugged:ddb0a081-44ae-4078-a6e3-6ef517eaaabd for instance e76bd5f8-b0be-4230-8011-a683fcb41d21 on hv-cinder-81883 Jan 27 16:55:26.089479 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-6296f2cf-4416-4313-b7ff-ecae7a3959b4 req-3b80710f-1c78-4bac-950d-9c287b0639fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032080 Jan 27 16:55:26.090077 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 528/1074] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:26.436740 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:26.437346 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:26.443082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:26.443528 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:26.444324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:26.444751 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:26.574349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:26.582310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:26.583858 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:26.585049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c4d5d501-771a-458d-8f44-2b800c1e57a1 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1719 microversion: 2.20 time: 0.151995 Jan 27 16:55:26.585606 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 547/1075] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:26 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:26.973737 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:26.974432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:26.980676 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:26.981124 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:26.981889 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:26.982324 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.115212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:27.122677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7e3887e9-c036-410b-98e2-4e25eeb068df tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1265 microversion: 2.1 time: 0.153352 Jan 27 16:55:27.123248 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 529/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:26 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:27.584103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:27.585018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:27.591739 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.592190 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.592963 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.593395 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.603700 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:27.604316 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:27.610128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.610579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.611353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.611818 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.624002 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8566eae5-6583-4df5-aebd-99976aad289f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Jan 27 16:55:27.624565 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 548/1077] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:27 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:27.634176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:27.634687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:27.640556 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.641008 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.641773 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.642201 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.672764 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6c9f4390-6986-4d1f-9a8e-3f2bccf8da00 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a" status: 200 len: 194 microversion: 2.1 time: 0.042355 Jan 27 16:55:27.673635 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 549/1078] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jan 27 16:55:27 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:55:27.749979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:27.757707 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:27.759935 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:27.761151 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-85d4c2e9-982a-457f-82ec-075a0b36e348 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1662 microversion: 2.20 time: 0.161661 Jan 27 16:55:27.761730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 530/1079] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:27 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1662 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:27.779313 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d20abee-9410-459b-8968-b6ea64c14317"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:27.780409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:27.786392 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.786842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:27.787786 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:27.788225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.078090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e02d14ba-a32c-42de-8e90-c16df0492702 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302676 Jan 27 16:55:28.079045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 550/1080] 10.222.0.48 () {62 vars in 1363 bytes} [Thu Jan 27 16:55:27 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 27 16:55:28.107310 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-ab34d0b1-d26d-4945-8be0-ef824c7e3968 req-d410b98a-6a06-4b82-ab2e-1a1b586a378c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "name": "network-vif-unplugged", "status": "completed", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:28.109143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:28.109143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:28.116397 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-ab34d0b1-d26d-4945-8be0-ef824c7e3968 req-d410b98a-6a06-4b82-ab2e-1a1b586a378c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.116910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-ab34d0b1-d26d-4945-8be0-ef824c7e3968 req-d410b98a-6a06-4b82-ab2e-1a1b586a378c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.127966 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.compute.server_external_events [req-ab34d0b1-d26d-4945-8be0-ef824c7e3968 req-d410b98a-6a06-4b82-ab2e-1a1b586a378c service nova] Unable to find a host for instance 094ca1ee-6735-4773-88c3-f81551f79fec. Dropping event network-vif-unplugged {{(pid=127795) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 27 16:55:28.128914 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-ab34d0b1-d26d-4945-8be0-ef824c7e3968 req-d410b98a-6a06-4b82-ab2e-1a1b586a378c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025469 Jan 27 16:55:28.129575 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 531/1081] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 27 16:55:28.139630 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:28.140269 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.146147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.146591 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.147357 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.147815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.190098 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:28.190579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.199693 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.200148 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.200934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.201366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.287665 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:28.295678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fb8e920f-55dc-4707-aa3a-84305b2dc937 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1450 microversion: 2.1 time: 0.160040 Jan 27 16:55:28.296249 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 551/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:28 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:28.311856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:28.312461 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.318678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.319132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.319928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.320361 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.428923 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-393cac29-1155-42c8-b599-352efe711a09 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments/5d20abee-9410-459b-8968-b6ea64c14317" status: 202 len: 0 microversion: 2.20 time: 0.242363 Jan 27 16:55:28.429677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 532/1083] 10.222.0.48 () {60 vars in 1456 bytes} [Thu Jan 27 16:55:28 2022] DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments/5d20abee-9410-459b-8968-b6ea64c14317 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:55:28.456890 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:28.465171 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-07ce8f09-016c-4908-8b00-46252eef3f15 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1450 microversion: 2.1 time: 0.156967 Jan 27 16:55:28.465746 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 552/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:28 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:55:28.482430 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:28.482994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.489392 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.489838 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.490609 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.491039 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.568806 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3c65bc0d-bcfa-4be0-a2d0-fe6996edaf5d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action" status: 202 len: 0 microversion: 2.20 time: 0.089840 Jan 27 16:55:28.569594 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 533/1085] 10.222.0.48 () {62 vars in 1318 bytes} [Thu Jan 27 16:55:28 2022] POST /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:55:28.577743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:28.578694 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.585168 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.585741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.586971 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.587410 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:28.784113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:28.793116 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:28.794605 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:28.795914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-661aa425-1c33-4f5b-b5e9-87c0a992192f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1670 microversion: 2.20 time: 0.221719 Jan 27 16:55:28.796542 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 553/1086] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:28 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:28.989950 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b35ea9ea-095e-4a2e-8c03-5fc284ec0560"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:28.991447 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:28.998535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:28.998989 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:29.004852 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:29.007162 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:29.279742 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-735cacc7-c59b-4f20-868d-3e1e17b63f76 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293893 Jan 27 16:55:29.299273 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 534/1087] 10.222.0.48 () {60 vars in 1322 bytes} [Thu Jan 27 16:55:28 2022] POST /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:29.814089 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:29.814634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:29.822056 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:29.822471 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:29.823254 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:29.823714 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:30.100297 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:30.108592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:30.110087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:30.121199 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c9b14f96-722f-4b64-9201-14ff2daabe2f tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.310784 Jan 27 16:55:30.121799 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 554/1088] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:29 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:30.494120 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-cc9f6ea5-cb18-4302-8b24-0937c1edc443 req-a210f4a9-3a23-4251-b80b-30f8b02058eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76bd5f8-b0be-4230-8011-a683fcb41d21", "tag": "ddb0a081-44ae-4078-a6e3-6ef517eaaabd"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:30.495623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:30.495623 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:30.510730 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-cc9f6ea5-cb18-4302-8b24-0937c1edc443 req-a210f4a9-3a23-4251-b80b-30f8b02058eb service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:30.511850 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-cc9f6ea5-cb18-4302-8b24-0937c1edc443 req-a210f4a9-3a23-4251-b80b-30f8b02058eb service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:30.527822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-cc9f6ea5-cb18-4302-8b24-0937c1edc443 req-a210f4a9-3a23-4251-b80b-30f8b02058eb service nova] Creating event network-changed:ddb0a081-44ae-4078-a6e3-6ef517eaaabd for instance e76bd5f8-b0be-4230-8011-a683fcb41d21 on hv-cinder-81883 Jan 27 16:55:30.533637 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-cc9f6ea5-cb18-4302-8b24-0937c1edc443 req-a210f4a9-3a23-4251-b80b-30f8b02058eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044283 Jan 27 16:55:30.537719 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 535/1089] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:31.144050 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:31.145376 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:31.153166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:31.154006 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:31.154887 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:31.155332 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:31.336389 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:31.345424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:31.347143 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:31.349857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c6cb56b3-ded9-4859-8448-41ea4d92d8fe tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.209818 Jan 27 16:55:31.350594 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 555/1090] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:31 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:32.369589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:32.370275 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:32.380335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:32.380781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:32.381771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:32.382205 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:32.556412 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:32.574582 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:32.576212 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:32.578168 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-411d2f23-12d9-4b8d-9234-89d919889e4d tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.212604 Jan 27 16:55:32.590093 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 536/1091] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:32 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:33.598530 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:33.599207 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:33.606175 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:33.606626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:33.607408 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:33.607875 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:33.753529 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:33.761933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:33.763857 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:33.765119 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c4df9763-e877-485f-a9f4-8662ab0ac6d7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.170794 Jan 27 16:55:33.765760 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 556/1092] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:33 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 27 16:55:34.787858 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:34.789015 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:34.796808 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:34.797368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:34.798182 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:34.798808 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:34.942087 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:34.951318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:34.952910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:34.954072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d7235b39-4a3b-4fda-8286-a8f9c0316d74 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.170976 Jan 27 16:55:34.954613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 537/1093] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:34 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:35.971647 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:35.972215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:35.979235 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:35.979743 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:35.980538 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:35.980972 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:36.120625 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:36.128732 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:36.130225 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:36.131394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-26a611eb-280c-4442-a96e-ae590f704ec4 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.163588 Jan 27 16:55:36.132019 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 557/1094] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:35 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:37.150295 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:37.150912 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:37.157284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:37.157736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:37.158521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:37.158961 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:37.321067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:37.329959 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:37.331446 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:37.332825 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-bf4f8542-6c82-4bd1-91d1-b7edbf4b72d8 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.186160 Jan 27 16:55:37.338616 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 538/1095] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:37 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:38.356362 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:38.356977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:38.363340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:38.363827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:38.364639 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:38.365077 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:38.494344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:38.505756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:38.507239 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:38.508562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-62441d67-4b25-4c2d-8b66-3408fb5efd9e tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.155945 Jan 27 16:55:38.509113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 558/1096] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:38 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:39.526478 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:39.527082 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:39.533343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:39.533789 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:39.534560 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:39.534995 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:39.669203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:39.676982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:39.678500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:39.679874 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-37609700-9d4e-4c2e-b422-702d760c81a7 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.157502 Jan 27 16:55:39.680375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 539/1097] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:39 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:39.966080 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:39.967045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:39.973456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:39.973903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:39.974678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:39.975113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.004827 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f41c94fc-7534-4c7d-82b1-b5b10b6f6075 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042446 Jan 27 16:55:40.005394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 559/1098] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:39 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:40.244591 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:40.245080 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:40.250837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.251277 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.252069 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.252500 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.281083 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a496eb31-43a9-4085-a067-67d826924408 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a" status: 200 len: 194 microversion: 2.1 time: 0.040911 Jan 27 16:55:40.281655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 540/1099] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jan 27 16:55:40 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:40.291658 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:40.292152 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:40.297894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.298355 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.299115 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.299552 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.374224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lazy-loading 'services' on Instance uuid e8c22100-7616-4a07-842e-64004815a6ca {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:55:40.443382 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-772edbb1-e948-4f88-afdf-93435fc0bf92 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a" status: 202 len: 0 microversion: 2.1 time: 0.155672 Jan 27 16:55:40.444020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 560/1100] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:55:40 2022] DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/3fe3382f-38e2-4199-a3cf-90472479210a => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:40.698394 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:40.699006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:40.705190 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.705634 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.706403 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:40.706836 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:40.838082 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:40.846043 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:40.847524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:40.848718 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-873ad34d-92e7-4fa4-a49a-b49a2e8887c5 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.154516 Jan 27 16:55:40.849271 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 541/1101] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:40 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:41.554074 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:41.554919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:41.561599 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.562045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:41.562810 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.563241 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:41.591442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c4756a80-c60d-4106-8fb4-64222517bac4 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/b35ea9ea-095e-4a2e-8c03-5fc284ec0560" status: 200 len: 194 microversion: 2.1 time: 0.041672 Jan 27 16:55:41.592057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 561/1102] 10.222.0.48 () {58 vars in 1412 bytes} [Thu Jan 27 16:55:41 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/b35ea9ea-095e-4a2e-8c03-5fc284ec0560 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:41.601981 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:41.602544 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:41.608314 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.608763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:41.609531 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.609963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:41.686755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lazy-loading 'services' on Instance uuid e8c22100-7616-4a07-842e-64004815a6ca {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:55:41.752915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b44d8948-a78d-48ee-8322-a0b7176abca1 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/b35ea9ea-095e-4a2e-8c03-5fc284ec0560" status: 202 len: 0 microversion: 2.1 time: 0.155051 Jan 27 16:55:41.753663 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 542/1103] 10.222.0.48 () {58 vars in 1415 bytes} [Thu Jan 27 16:55:41 2022] DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments/b35ea9ea-095e-4a2e-8c03-5fc284ec0560 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:41.866123 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:41.867325 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:41.873110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.873583 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:41.874350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:41.874781 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:42.005303 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:42.014818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:42.016366 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:42.017533 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-77dedcbf-2d1a-42bf-bb07-fda1d15c2918 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.155260 Jan 27 16:55:42.018097 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 562/1104] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:41 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:42.159771 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-21d7ee2f-f6e4-4869-bcb4-950136497965 req-d1d5d969-ee87-40ee-ace8-4701552d1bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "name": "network-vif-plugged", "status": "completed", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:42.161312 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:42.161312 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:42.168356 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-21d7ee2f-f6e4-4869-bcb4-950136497965 req-d1d5d969-ee87-40ee-ace8-4701552d1bb3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:42.168802 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-21d7ee2f-f6e4-4869-bcb4-950136497965 req-d1d5d969-ee87-40ee-ace8-4701552d1bb3 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:42.179523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-21d7ee2f-f6e4-4869-bcb4-950136497965 req-d1d5d969-ee87-40ee-ace8-4701552d1bb3 service nova] Creating event network-vif-plugged:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:55:42.184433 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-21d7ee2f-f6e4-4869-bcb4-950136497965 req-d1d5d969-ee87-40ee-ace8-4701552d1bb3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028712 Jan 27 16:55:42.185344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 543/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:42.905564 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:42.906506 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:42.912669 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:42.913109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:42.914903 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:42.915337 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:42.946757 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-bc3e245f-0156-4e92-8887-706fbf5e761f tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044852 Jan 27 16:55:42.947310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 563/1106] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:42 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 27 16:55:43.037430 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:43.038153 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:43.044224 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.044672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.045448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.045886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.047062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:43.048065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:43.053697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.054765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.055901 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.056336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.086826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ffe9d249-9a04-4e73-872d-858e9a0e534c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043189 Jan 27 16:55:43.087315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 564/1107] 10.222.0.48 () {58 vars in 1301 bytes} [Thu Jan 27 16:55:43 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 27 16:55:43.142095 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:43.142588 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:43.148435 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.148916 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.149683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.150114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.173966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:55:43.181572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:43.189497 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:43.190979 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:43.192186 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3bd3a68f-2fb5-4b61-8ce7-255576e1832c tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1728 microversion: 2.20 time: 0.159150 Jan 27 16:55:43.192738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 544/1108] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:43 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:43.246315 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6ea60456-0a0d-4d0a-a455-8caae4e7b0c9 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 204 len: 0 microversion: 2.1 time: 0.107536 Jan 27 16:55:43.246909 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 565/1109] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:55:43 2022] DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 16:55:43.256230 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:43.257298 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:43.263752 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.264203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.264985 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:43.265423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:43.389498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:43.396624 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a5441608-c155-488a-bcd2-dca3f986524c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1672 microversion: 2.1 time: 0.145375 Jan 27 16:55:43.397184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 545/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:43 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:44.211400 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:44.212141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:44.219100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:44.219677 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:44.220456 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:44.220888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:44.350736 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:44.358394 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:44.359907 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:44.361053 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-08e8f895-a72a-4ee9-9126-165fa3e3ed9a tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1715 microversion: 2.20 time: 0.154634 Jan 27 16:55:44.361604 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 566/1111] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:55:44 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:55:44.414785 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:44.415390 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:44.421714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:44.422161 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:44.422933 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:44.423372 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:44.550323 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:44.557640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-897a4bb2-f6ef-4b95-984b-87ab1fcbeef8 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1672 microversion: 2.1 time: 0.147301 Jan 27 16:55:44.558199 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 546/1112] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:44 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1672 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:45.574437 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:45.575045 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:45.581277 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:45.581725 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:45.582505 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:45.582932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:45.711826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:45.719121 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-a912867f-015a-4006-9e4b-b972f1c0178c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1672 microversion: 2.1 time: 0.149380 Jan 27 16:55:45.719919 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 567/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:45 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:46.274784 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-29689b0d-3e0e-40b0-9d71-491a0d8d5ce4 req-565b1b0c-1cd4-4a45-9170-1fa9617a1499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c22100-7616-4a07-842e-64004815a6ca", "name": "network-vif-deleted", "tag": "97743adb-f50c-4603-8490-a5dc53d3afb5"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:46.276636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:55:46.276636 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:55:46.284757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-29689b0d-3e0e-40b0-9d71-491a0d8d5ce4 req-565b1b0c-1cd4-4a45-9170-1fa9617a1499 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:46.285366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-29689b0d-3e0e-40b0-9d71-491a0d8d5ce4 req-565b1b0c-1cd4-4a45-9170-1fa9617a1499 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:46.298928 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-29689b0d-3e0e-40b0-9d71-491a0d8d5ce4 req-565b1b0c-1cd4-4a45-9170-1fa9617a1499 service nova] Creating event network-vif-deleted:97743adb-f50c-4603-8490-a5dc53d3afb5 for instance e8c22100-7616-4a07-842e-64004815a6ca on hv-cinder-81883 Jan 27 16:55:46.303763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-29689b0d-3e0e-40b0-9d71-491a0d8d5ce4 req-565b1b0c-1cd4-4a45-9170-1fa9617a1499 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033681 Jan 27 16:55:46.304566 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 547/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:46.737011 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:46.737770 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:46.744434 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:46.745258 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:46.746154 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:46.746687 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:46.782638 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:46.783365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:46.783900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lazy-loading 'fault' on Instance uuid e8c22100-7616-4a07-842e-64004815a6ca {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:55:46.826401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20137a83d3de4dcfaba05ab93c470829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accb650bdbfa4de4a4129fd473ca736d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:55:46.833100 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-080d4791-1dc6-4772-b54d-b80fe2c7fa4c tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 200 len: 1327 microversion: 2.1 time: 0.099822 Jan 27 16:55:46.833768 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 568/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:46 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:55:47.850839 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:47.851508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:47.857534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:47.857976 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:47.858736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:47.859169 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:47.872267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. Jan 27 16:55:47.872833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:47.873628 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-364f2cdc-3683-4b43-8ef1-61718ebab201 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 404 len: 111 microversion: 2.1 time: 0.027366 Jan 27 16:55:47.874140 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 548/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:47 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:47.882914 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3580c3f3-ca92-43fb-a048-201a9a5e64ad tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '.version_select at 0x7f0cf07505e0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:47.899869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3580c3f3-ca92-43fb-a048-201a9a5e64ad tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312010021" status: 202 len: 0 microversion: 2.1 time: 0.021309 Jan 27 16:55:47.900424 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 569/1117] 10.222.0.48 () {58 vars in 1220 bytes} [Thu Jan 27 16:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312010021 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:55:50.758727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:50.759228 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:50.765757 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:50.766194 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:50.766957 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:50.767386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:50.781881 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. Jan 27 16:55:50.782472 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:50.783303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-aa5393d9-2254-4020-8944-4ac8c4dca945 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 404 len: 111 microversion: 2.1 time: 0.028700 Jan 27 16:55:50.783884 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 549/1118] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:55:50 2022] DELETE /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:50.793926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:50.794562 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: e8c22100-7616-4a07-842e-64004815a6ca] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:50.800678 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:50.801141 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:50.802022 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:50.802555 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:50.815925 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. Jan 27 16:55:50.816521 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance e8c22100-7616-4a07-842e-64004815a6ca could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:50.817377 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-549da588-64c1-4b2d-898b-cc63cd0c5972 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca" status: 404 len: 111 microversion: 2.1 time: 0.029463 Jan 27 16:55:50.817918 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 570/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:50 2022] GET /compute/v2.1/servers/e8c22100-7616-4a07-842e-64004815a6ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:51.956774 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:51.957368 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:51.963964 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:51.964593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:51.965360 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:51.965790 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:51.980861 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. Jan 27 16:55:51.981428 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:51.982224 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5c757af9-25d2-428b-a496-0de3a1b716df tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 404 len: 111 microversion: 2.1 time: 0.029130 Jan 27 16:55:51.982738 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 550/1120] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:55:51 2022] DELETE /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:51.990262 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:51.990877 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] [instance: 27dbabab-3baf-4446-aaad-bdd80b162cd7] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:55:51.997688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:51.998132 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:51.998900 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:55:51.999333 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:55:52.012360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] HTTP exception thrown: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. Jan 27 16:55:52.012928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] Returning 404 to user: Instance 27dbabab-3baf-4446-aaad-bdd80b162cd7 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:55:52.013723 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c3794429-b863-44b2-9c9a-d067f5130c60 tempest-AttachVolumeTestJSON-1049700409 tempest-AttachVolumeTestJSON-1049700409-project] 10.222.0.48 "GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7" status: 404 len: 111 microversion: 2.1 time: 0.027118 Jan 27 16:55:52.014231 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 571/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:55:51 2022] GET /compute/v2.1/servers/27dbabab-3baf-4446-aaad-bdd80b162cd7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:56.498590 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-3150b335-8d74-4089-8678-bfb9edfcdeb5 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Action: 'create', calling method: .version_select at 0x7f0cf0de01f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-146942746"}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:56.790022 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-3150b335-8d74-4089-8678-bfb9edfcdeb5 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.417925 Jan 27 16:55:56.790646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 551/1122] 10.222.0.48 () {60 vars in 1154 bytes} [Thu Jan 27 16:55:56 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 27 16:55:56.806110 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-761a17e6-f043-4a23-8351-99159cbc9a57 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0659ee0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:56.860637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-761a17e6-f043-4a23-8351-99159cbc9a57 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 200 len: 344 microversion: 2.1 time: 0.061633 Jan 27 16:55:56.861291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 572/1123] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:55:56 2022] GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:57.873880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ad2805d7-d69e-40da-96e1-6b20b72579d2 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0f714c0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:57.918755 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ad2805d7-d69e-40da-96e1-6b20b72579d2 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 200 len: 345 microversion: 2.1 time: 0.049003 Jan 27 16:55:57.919311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 552/1124] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:55:57 2022] GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:57.931046 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-c2fdf55e-550f-479c-8c37-ad5e3205af18 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Action: 'create', calling method: .version_select at 0x7f0cf07b48b0>, body: {"snapshot": {"volume_id": "20a97a3c-86cd-430f-8274-fc5e7541c9ac", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1619086348"}} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:55:58.071472 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-c2fdf55e-550f-479c-8c37-ad5e3205af18 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.145060 Jan 27 16:55:58.072097 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 573/1125] 10.222.0.48 () {60 vars in 1161 bytes} [Thu Jan 27 16:55:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:58.081639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8587ab49-3206-49be-84bb-f708ceb95c76 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0f143a0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:58.111959 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8587ab49-3206-49be-84bb-f708ceb95c76 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 287 microversion: 2.1 time: 0.033879 Jan 27 16:55:58.112727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 553/1126] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:55:58 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:58.122720 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4fe368bf-8a94-47ec-9028-ec2af6c599f6 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf04e7940>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:58.150700 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4fe368bf-8a94-47ec-9028-ec2af6c599f6 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031601 Jan 27 16:55:58.151261 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 574/1127] 10.222.0.48 () {58 vars in 1139 bytes} [Thu Jan 27 16:55:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:58.160765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dc452d9e-34c6-4006-831b-20f68d6da650 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0fb2e50>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:58.188326 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dc452d9e-34c6-4006-831b-20f68d6da650 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 287 microversion: 2.1 time: 0.031032 Jan 27 16:55:58.188886 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 554/1128] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:55:58 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 287 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:55:59.200616 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5037878c-92b2-483e-9b24-9ef850412841 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf066ea60>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:55:59.228504 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5037878c-92b2-483e-9b24-9ef850412841 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 287 microversion: 2.1 time: 0.031921 Jan 27 16:55:59.229044 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 575/1129] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:55:59 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:00.240272 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-07ca8695-12fb-4847-90c1-5461e2329fad tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0c299d0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:00.269488 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-07ca8695-12fb-4847-90c1-5461e2329fad tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 287 microversion: 2.1 time: 0.033294 Jan 27 16:56:00.270042 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 555/1130] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:56:00 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:01.282215 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-44bdbdd1-76b9-42a5-ae46-c01573426110 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf040f670>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:01.311017 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-44bdbdd1-76b9-42a5-ae46-c01573426110 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 288 microversion: 2.1 time: 0.032869 Jan 27 16:56:01.311631 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 576/1131] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:56:01 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:01.321626 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-356862f8-762d-474b-b177-0e9b27254a8a tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0e69700>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:01.375471 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-356862f8-762d-474b-b177-0e9b27254a8a tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 202 len: 0 microversion: 2.1 time: 0.057800 Jan 27 16:56:01.376067 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 556/1132] 10.222.0.48 () {58 vars in 1253 bytes} [Thu Jan 27 16:56:01 2022] DELETE /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:56:01.385526 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-9aa6573c-b4bb-4e33-9670-6fe0e4db2c00 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf040f3a0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:01.413447 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-9aa6573c-b4bb-4e33-9670-6fe0e4db2c00 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 200 len: 287 microversion: 2.1 time: 0.032470 Jan 27 16:56:01.413990 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 577/1133] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:56:01 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:02.425157 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5ee8dfb2-9cd7-46bb-9dad-8f34f52b924f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0f14dc0>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:02.448648 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-5ee8dfb2-9cd7-46bb-9dad-8f34f52b924f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] HTTP exception thrown: Snapshot 18d4b5a9-ed08-45d3-b2f6-77546d94b8dc could not be found. Jan 27 16:56:02.449225 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5ee8dfb2-9cd7-46bb-9dad-8f34f52b924f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Returning 404 to user: Snapshot 18d4b5a9-ed08-45d3-b2f6-77546d94b8dc could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:02.450055 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5ee8dfb2-9cd7-46bb-9dad-8f34f52b924f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc" status: 404 len: 111 microversion: 2.1 time: 0.029069 Jan 27 16:56:02.450570 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 557/1134] 10.222.0.48 () {58 vars in 1250 bytes} [Thu Jan 27 16:56:02 2022] GET /compute/v2.1/os-snapshots/18d4b5a9-ed08-45d3-b2f6-77546d94b8dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:56:02.458873 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-043f3a75-9808-4618-8da8-2d13db98c170 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf06595e0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:02.518427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-043f3a75-9808-4618-8da8-2d13db98c170 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 202 len: 0 microversion: 2.1 time: 0.063542 Jan 27 16:56:02.519016 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 578/1135] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:56:02 2022] DELETE /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:56:02.528464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-cde196cd-3911-4267-bbd6-579854197d9f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0dc9310>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:02.575498 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-cde196cd-3911-4267-bbd6-579854197d9f tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 200 len: 344 microversion: 2.1 time: 0.051245 Jan 27 16:56:02.576093 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 558/1136] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:56:02 2022] GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:03.588966 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-13f8e11f-3aba-4fa9-9d70-0055beec7eb8 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf06213a0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:03.616086 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-13f8e11f-3aba-4fa9-9d70-0055beec7eb8 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] HTTP exception thrown: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. Jan 27 16:56:03.616698 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-13f8e11f-3aba-4fa9-9d70-0055beec7eb8 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Returning 404 to user: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:03.617554 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-13f8e11f-3aba-4fa9-9d70-0055beec7eb8 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 404 len: 109 microversion: 2.1 time: 0.033285 Jan 27 16:56:03.618082 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 579/1137] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:56:03 2022] GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:56:03.632139 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fcfb1f50-6487-4e56-90a2-cb632066bc26 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf0e69550>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:03.666016 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-fcfb1f50-6487-4e56-90a2-cb632066bc26 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] HTTP exception thrown: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. Jan 27 16:56:03.666639 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fcfb1f50-6487-4e56-90a2-cb632066bc26 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Returning 404 to user: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:03.667464 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fcfb1f50-6487-4e56-90a2-cb632066bc26 tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 404 len: 109 microversion: 2.1 time: 0.039459 Jan 27 16:56:03.668039 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 559/1138] 10.222.0.48 () {58 vars in 1247 bytes} [Thu Jan 27 16:56:03 2022] DELETE /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:56:03.675473 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1fd38fad-16c7-4970-9de7-a459bcf5bfec tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Calling method '.version_select at 0x7f0cf05d9790>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:03.701018 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-1fd38fad-16c7-4970-9de7-a459bcf5bfec tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] HTTP exception thrown: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. Jan 27 16:56:03.701614 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1fd38fad-16c7-4970-9de7-a459bcf5bfec tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] Returning 404 to user: Volume 20a97a3c-86cd-430f-8274-fc5e7541c9ac could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:03.702429 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1fd38fad-16c7-4970-9de7-a459bcf5bfec tempest-VolumesSnapshotsTestJSON-1551726443 tempest-VolumesSnapshotsTestJSON-1551726443-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac" status: 404 len: 109 microversion: 2.1 time: 0.030550 Jan 27 16:56:03.702965 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 580/1139] 10.222.0.48 () {58 vars in 1244 bytes} [Thu Jan 27 16:56:03 2022] GET /compute/v2.1/os-volumes/20a97a3c-86cd-430f-8274-fc5e7541c9ac => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:56:17.941736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:17.943458 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:17.949439 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:17.949887 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:17.950665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:17.951097 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:17.979112 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-93cf0b46-c574-49c2-a265-daf89c855886 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041648 Jan 27 16:56:17.979672 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 560/1140] 10.222.0.48 () {60 vars in 1342 bytes} [Thu Jan 27 16:56:17 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:56:18.034092 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:18.035314 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:18.041921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:18.042370 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:18.043151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:18.043608 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:18.067491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Going to try to terminate instance {{(pid=127796) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:56:18.139327 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-8866b4be-adb4-472f-aaf0-997510e68058 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 204 len: 0 microversion: 2.20 time: 0.109183 Jan 27 16:56:18.140203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 581/1141] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jan 27 16:56:18 2022] DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 27 16:56:18.149873 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:18.150424 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:18.156477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:18.156930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:18.157703 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:18.158137 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:18.288892 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:18.296783 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:18.298281 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:18.299473 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-016e3710-07a1-4b13-a93a-896968408de0 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.154244 Jan 27 16:56:18.300058 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 561/1142] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:18 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:56:19.318412 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:19.319057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:19.325488 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:19.325942 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:19.326725 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:19.327164 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:19.455790 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:19.464007 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:19.465539 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:19.466766 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-69749c8e-f186-47bc-8d79-dbd03338fada tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1721 microversion: 2.20 time: 0.153084 Jan 27 16:56:19.467324 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 582/1143] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:19 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:56:20.372662 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-2365f88b-a09b-49ed-855c-1ff351536750 req-00f7b021-280e-4da4-9853-6a93a1d83d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "094ca1ee-6735-4773-88c3-f81551f79fec", "name": "network-vif-deleted", "tag": "c65d8b4a-3134-49fd-9fd6-0ca9592da86a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:56:20.374955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:56:20.374955 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:56:20.383477 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-2365f88b-a09b-49ed-855c-1ff351536750 req-00f7b021-280e-4da4-9853-6a93a1d83d87 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:20.384359 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-2365f88b-a09b-49ed-855c-1ff351536750 req-00f7b021-280e-4da4-9853-6a93a1d83d87 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:20.396408 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-2365f88b-a09b-49ed-855c-1ff351536750 req-00f7b021-280e-4da4-9853-6a93a1d83d87 service nova] Creating event network-vif-deleted:c65d8b4a-3134-49fd-9fd6-0ca9592da86a for instance 094ca1ee-6735-4773-88c3-f81551f79fec on hv-cinder-81883 Jan 27 16:56:20.402423 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-2365f88b-a09b-49ed-855c-1ff351536750 req-00f7b021-280e-4da4-9853-6a93a1d83d87 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033486 Jan 27 16:56:20.403485 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 562/1144] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:20.487987 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:20.489344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:20.500065 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:20.500518 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:20.505639 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:20.506098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:20.569573 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:20.570277 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:20.571098 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lazy-loading 'fault' on Instance uuid 094ca1ee-6735-4773-88c3-f81551f79fec {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:56:20.625444 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:20.638009 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:20.640431 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd2a59a36a2e422795e977c7af5004e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11d012d792424a858b876a618c79f7af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:20.641551 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3816c9b5-15aa-4d45-8cb0-15a4e62cc367 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 200 len: 1370 microversion: 2.20 time: 0.159384 Jan 27 16:56:20.642131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 583/1145] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:20 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 27 16:56:21.662335 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:21.663061 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:21.669288 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:21.669736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:21.670514 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:21.670951 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:21.686563 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. Jan 27 16:56:21.687152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:21.688191 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-ecc4d3c0-8226-4f94-9e6c-96dcbdfe7416 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 404 len: 111 microversion: 2.20 time: 0.030731 Jan 27 16:56:21.688736 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 563/1146] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:21 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:56:21.696930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fc1e3dc3-0708-4169-9e8d-393682456296 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '.version_select at 0x7f0cf0599af0>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:21.714753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fc1e3dc3-0708-4169-9e8d-393682456296 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489945461" status: 204 len: 0 microversion: 2.20 time: 0.021461 Jan 27 16:56:21.715443 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 584/1147] 10.222.0.48 () {60 vars in 1258 bytes} [Thu Jan 27 16:56:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489945461 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 27 16:56:23.477826 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:23.478352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:23.484557 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:23.485003 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:23.485772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:23.486204 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:23.500034 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. Jan 27 16:56:23.500615 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:23.501431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-51345a73-3628-45cc-bbb4-7fe323cd669b tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 404 len: 111 microversion: 2.20 time: 0.027774 Jan 27 16:56:23.501963 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 564/1148] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jan 27 16:56:23 2022] DELETE /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:56:23.509863 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:23.510737 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: 094ca1ee-6735-4773-88c3-f81551f79fec] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:23.517609 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:23.518062 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:23.518838 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:23.519275 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:23.532829 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. Jan 27 16:56:23.533419 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance 094ca1ee-6735-4773-88c3-f81551f79fec could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:23.534271 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-bd3a084a-6478-4670-a68a-e507ef86bb17 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec" status: 404 len: 111 microversion: 2.20 time: 0.028151 Jan 27 16:56:23.534807 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 585/1149] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:23 2022] GET /compute/v2.1/servers/094ca1ee-6735-4773-88c3-f81551f79fec => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:56:24.662006 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:24.662890 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:24.668722 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:24.669152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:24.669919 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:24.670353 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:24.683991 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. Jan 27 16:56:24.684577 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:24.685395 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-6c8b1178-3028-468d-b961-986efe665678 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 404 len: 111 microversion: 2.20 time: 0.027718 Jan 27 16:56:24.686625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 565/1150] 10.222.0.48 () {60 vars in 1279 bytes} [Thu Jan 27 16:56:24 2022] DELETE /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:56:24.693985 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:24.694688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] [instance: f7ddbd2c-1d14-4efe-9228-3feaa97ef620] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:24.700756 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:24.701214 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:24.702020 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:24.702462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:24.717288 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] HTTP exception thrown: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. Jan 27 16:56:24.717869 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] Returning 404 to user: Instance f7ddbd2c-1d14-4efe-9228-3feaa97ef620 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:24.718683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-7f425d65-ed9e-4db4-9c16-14a5b4c94568 tempest-AttachVolumeShelveTestJSON-454786362 tempest-AttachVolumeShelveTestJSON-454786362-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620" status: 404 len: 111 microversion: 2.20 time: 0.028751 Jan 27 16:56:24.719212 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 586/1151] 10.222.0.48 () {60 vars in 1276 bytes} [Thu Jan 27 16:56:24 2022] GET /compute/v2.1/servers/f7ddbd2c-1d14-4efe-9228-3feaa97ef620 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 27 16:56:27.292994 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:27.293552 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:27.295670 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-dc9b2a77-a299-430e-8ad4-5f562cfe575c req-6314e862-7e1a-4437-9b15-d315d1a7b368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:56:27.297268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:56:27.297268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:56:27.305365 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-dc9b2a77-a299-430e-8ad4-5f562cfe575c req-6314e862-7e1a-4437-9b15-d315d1a7b368 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:27.306090 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-dc9b2a77-a299-430e-8ad4-5f562cfe575c req-6314e862-7e1a-4437-9b15-d315d1a7b368 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:27.306479 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:27.307007 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:27.308017 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:27.308735 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:27.317905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-dc9b2a77-a299-430e-8ad4-5f562cfe575c req-6314e862-7e1a-4437-9b15-d315d1a7b368 service nova] Creating event network-changed:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:56:27.323470 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-dc9b2a77-a299-430e-8ad4-5f562cfe575c req-6314e862-7e1a-4437-9b15-d315d1a7b368 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031474 Jan 27 16:56:27.324165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 587/1152] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:27.361199 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:56:27.509035 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e1ae7535-ffb6-4f0d-b1eb-4552d916db8f tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 204 len: 0 microversion: 2.1 time: 0.219220 Jan 27 16:56:27.513038 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 566/1153] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:56:27 2022] DELETE /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:56:27.520057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:27.521114 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:27.530702 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:27.531507 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:27.532517 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:27.532955 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:27.792373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:27.800566 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6be5043f-7d10-418b-af5a-e4cf44e757ec tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.286001 Jan 27 16:56:27.811626 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 588/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:56:27 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:56:28.823537 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:28.824256 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:28.831559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:28.832358 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:28.833426 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:28.834220 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:28.981207 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:28.988750 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-eb9aa594-237b-4be1-8bf5-1019093cb133 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1567 microversion: 2.1 time: 0.170425 Jan 27 16:56:28.999111 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 567/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:56:28 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:56:30.006427 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:30.007774 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:30.015765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:30.016373 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:30.017462 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:30.018183 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:30.168379 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:30.176340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-2f39462b-54db-4337-8054-ce2af5cc65d1 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1448 microversion: 2.1 time: 0.173558 Jan 27 16:56:30.177847 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 589/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:56:30 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1448 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:56:30.517341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-d6ae4064-4639-4a27-b688-11eff273c2b9 req-cf94ac0e-b2a7-4447-acdc-cfa13f5328ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e2afd7a-cfd6-4228-b067-077d9f739343", "name": "network-vif-deleted", "tag": "4c6d1bb1-4016-470a-874a-0345faae637a"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:56:30.519474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:56:30.519474 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:56:30.530462 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d6ae4064-4639-4a27-b688-11eff273c2b9 req-cf94ac0e-b2a7-4447-acdc-cfa13f5328ac service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:30.530841 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-d6ae4064-4639-4a27-b688-11eff273c2b9 req-cf94ac0e-b2a7-4447-acdc-cfa13f5328ac service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:30.547631 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-d6ae4064-4639-4a27-b688-11eff273c2b9 req-cf94ac0e-b2a7-4447-acdc-cfa13f5328ac service nova] Creating event network-vif-deleted:4c6d1bb1-4016-470a-874a-0345faae637a for instance 7e2afd7a-cfd6-4228-b067-077d9f739343 on hv-cinder-81883 Jan 27 16:56:30.554680 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-d6ae4064-4639-4a27-b688-11eff273c2b9 req-cf94ac0e-b2a7-4447-acdc-cfa13f5328ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040760 Jan 27 16:56:30.555143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 568/1157] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:56:31.193868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:31.194504 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:31.210797 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:31.211250 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:31.212067 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:31.212688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:31.246266 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:31.246976 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:31.247623 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.objects.instance [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lazy-loading 'fault' on Instance uuid 7e2afd7a-cfd6-4228-b067-077d9f739343 {{(pid=127796) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 16:56:31.288835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1189e6ca83149dc95cc1a54c3c31421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c13f9d51cfe44de91903d2de6032c92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:56:31.295952 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5367a839-3e95-4f46-81a2-825eecbababb tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 200 len: 1177 microversion: 2.1 time: 0.105769 Jan 27 16:56:31.296753 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 590/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:56:31 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 1177 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:56:32.313837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:32.314545 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] [instance: 7e2afd7a-cfd6-4228-b067-077d9f739343] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:56:32.322507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:32.323203 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:32.324174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:56:32.324978 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:56:32.340199 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] HTTP exception thrown: Instance 7e2afd7a-cfd6-4228-b067-077d9f739343 could not be found. Jan 27 16:56:32.340788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Returning 404 to user: Instance 7e2afd7a-cfd6-4228-b067-077d9f739343 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:56:32.341807 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-857247de-fe40-43c8-9b18-43ce5ada7afe tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343" status: 404 len: 111 microversion: 2.1 time: 0.032244 Jan 27 16:56:32.342370 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 569/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:56:32 2022] GET /compute/v2.1/servers/7e2afd7a-cfd6-4228-b067-077d9f739343 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:56:32.601275 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-053f0861-c240-4046-af41-fce69b009cf6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] Calling method '.version_select at 0x7f0cf05d9280>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:56:32.625273 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-053f0861-c240-4046-af41-fce69b009cf6 tempest-TestShelveInstance-734885998 tempest-TestShelveInstance-734885998-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1061823013" status: 202 len: 0 microversion: 2.1 time: 0.028089 Jan 27 16:56:32.626942 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 591/1160] 10.222.0.48 () {58 vars in 1253 bytes} [Thu Jan 27 16:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1061823013 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 16:57:09.740509 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:57:09.741121 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 16:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:57:28.646977 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:28.647668 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:28.653328 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:28.653765 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:28.654525 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:28.654960 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:28.678508 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 16:57:28.749284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d50c01fa-fbfe-43b5-b769-e6cc1ba294b5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 204 len: 0 microversion: 2.1 time: 0.106524 Jan 27 16:57:28.750051 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 570/1161] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 16:57:28 2022] DELETE /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 16:57:28.760868 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:28.761411 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:28.768859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:28.769309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:28.770087 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:28.770524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:28.901474 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:28.909409 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-4f839077-8b0f-41a1-951e-f1465afae65f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1575 microversion: 2.1 time: 0.154210 Jan 27 16:57:28.910233 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 592/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:28 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 27 16:57:29.927258 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:29.927918 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:29.934099 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:29.934541 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:29.935303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:29.935758 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:30.072925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:30.080974 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8ae5c358-d444-41b1-93c6-2c5388f507e4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1575 microversion: 2.1 time: 0.157894 Jan 27 16:57:30.081530 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 571/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:29 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:31.085263 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-3aca6dc9-33f1-4a96-bfae-58404559323a req-a3b87654-02e6-4caf-bc0c-a2fd4ed2318e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76bd5f8-b0be-4230-8011-a683fcb41d21", "name": "network-vif-deleted", "tag": "ddb0a081-44ae-4078-a6e3-6ef517eaaabd"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:57:31.086697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:57:31.086697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:57:31.097291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-3aca6dc9-33f1-4a96-bfae-58404559323a req-a3b87654-02e6-4caf-bc0c-a2fd4ed2318e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:31.098210 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-3aca6dc9-33f1-4a96-bfae-58404559323a req-a3b87654-02e6-4caf-bc0c-a2fd4ed2318e service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:31.100311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:31.101072 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:31.109089 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:31.110142 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:31.111103 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:31.111346 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-3aca6dc9-33f1-4a96-bfae-58404559323a req-a3b87654-02e6-4caf-bc0c-a2fd4ed2318e service nova] Creating event network-vif-deleted:ddb0a081-44ae-4078-a6e3-6ef517eaaabd for instance e76bd5f8-b0be-4230-8011-a683fcb41d21 on hv-cinder-81883 Jan 27 16:57:31.112025 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:31.117134 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-3aca6dc9-33f1-4a96-bfae-58404559323a req-a3b87654-02e6-4caf-bc0c-a2fd4ed2318e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Jan 27 16:57:31.118144 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 593/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:57:31.180539 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:31.188751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dabbbc80-b16b-4ef1-b638-f4ba2769fb72 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 200 len: 1225 microversion: 2.1 time: 0.094238 Jan 27 16:57:31.189587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 572/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:31 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:32.206615 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:32.207309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:32.213350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:32.213819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:32.214580 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:32.215037 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:32.228257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] HTTP exception thrown: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. Jan 27 16:57:32.228826 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Returning 404 to user: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 16:57:32.229624 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-36160a32-73af-4ddc-a184-fcbf625500f6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 404 len: 111 microversion: 2.1 time: 0.027533 Jan 27 16:57:32.230137 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 594/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:32 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 16:57:32.370600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-841519063", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-699219578", "security_groups": [{"name": "tempest-secgroup-smoke-962365757"}], "block_device_mapping_v2": [{"uuid": "72aa3567-4f05-497a-8d1d-07d25f9e4544", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31086914-ef67-4638-ab4e-856fdab7280e"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:57:32.476432 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] validate_networks() for [('31086914-ef67-4638-ab4e-856fdab7280e', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:57:32.840223 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:57:32.840665 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:57:32.841126 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:57:32.841527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:57:32.841930 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:57:32.851008 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:32.851444 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:32.852267 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:32.852695 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:32.868523 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:57:32.872292 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for user 6bf586d36da74c29ab1a188bb6da8603 and project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:57:32.925830 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:57:32.927942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72aa3567-4f05-497a-8d1d-07d25f9e4544',volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:57:33.046606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-dc1788fe-6403-40c1-8ac8-b899ee537a97 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.679564 Jan 27 16:57:33.052727 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 573/1167] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:57:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:57:33.059231 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fc7611ae-ac12-4662-ba8a-2c35735867fe tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:33.059906 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fc7611ae-ac12-4662-ba8a-2c35735867fe tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:33.113928 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-fc7611ae-ac12-4662-ba8a-2c35735867fe tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:33.120621 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fc7611ae-ac12-4662-ba8a-2c35735867fe tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1093 microversion: 2.1 time: 0.066567 Jan 27 16:57:33.121194 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 595/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:33 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:34.138811 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:34.139448 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:34.145844 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:34.146286 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:34.147057 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:34.147524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:34.209632 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:34.217109 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-e25470c0-c239-4aea-87e1-400a60a12508 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1209 microversion: 2.1 time: 0.082424 Jan 27 16:57:34.227268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 574/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:34 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:35.221304 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-b0f57e9a-6176-4f5d-a26d-c0f1628471bc req-4aaaa857-bd75-4429-986e-a89ce2f4866c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d4bea1-c26d-474d-ac97-d1a46389b65a", "tag": "b30a7664-8526-4f19-9578-bcd6d070fa17"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:57:35.223735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:57:35.223735 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:57:35.233915 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:35.234707 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:35.246016 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b0f57e9a-6176-4f5d-a26d-c0f1628471bc req-4aaaa857-bd75-4429-986e-a89ce2f4866c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:35.246770 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:35.247451 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:35.248243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:35.248898 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b0f57e9a-6176-4f5d-a26d-c0f1628471bc req-4aaaa857-bd75-4429-986e-a89ce2f4866c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:35.249409 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:35.273414 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-b0f57e9a-6176-4f5d-a26d-c0f1628471bc req-4aaaa857-bd75-4429-986e-a89ce2f4866c service nova] Creating event network-changed:b30a7664-8526-4f19-9578-bcd6d070fa17 for instance 20d4bea1-c26d-474d-ac97-d1a46389b65a on hv-cinder-81883 Jan 27 16:57:35.278664 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-b0f57e9a-6176-4f5d-a26d-c0f1628471bc req-4aaaa857-bd75-4429-986e-a89ce2f4866c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063873 Jan 27 16:57:35.279359 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 596/1170] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:57:35.413578 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:35.420880 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4d96ba77-1893-4bbe-aa71-56406c8dcd17 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.190518 Jan 27 16:57:35.421431 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 575/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:35 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:36.439047 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:36.439697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:36.446360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:36.446805 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:36.447584 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:36.448036 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:36.577176 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:36.585147 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-33c4f623-7227-40fc-9cc2-c8d50c0b73e3 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.150650 Jan 27 16:57:36.585715 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 597/1172] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:36 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:37.602302 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:37.602906 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:37.609139 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:37.609587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:37.610341 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:37.610772 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:37.742213 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:37.749491 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-8d066e11-170d-4616-95c4-36a5046afb28 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.150843 Jan 27 16:57:37.750052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 576/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:37 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:38.766059 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:38.766697 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:38.773464 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:38.773913 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:38.774683 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:38.775113 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:38.902979 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:38.910885 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-32f5ba39-8685-4958-8504-67c3c131f825 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.148509 Jan 27 16:57:38.911482 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 598/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:38 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:39.927625 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:39.928171 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:39.934367 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:39.934809 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:39.935589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:39.936020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:40.064925 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:40.072731 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-5b8c79b1-fcde-40f1-981c-bc3ad354b36e tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.148911 Jan 27 16:57:40.073296 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 577/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:39 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:41.089360 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:41.089977 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:41.096930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:41.097561 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:41.098342 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:41.098779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:41.228534 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:41.235682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-de5e8465-37eb-45a5-b7bc-c6dd21cd6016 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.149996 Jan 27 16:57:41.236243 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 599/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:41 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:42.251958 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:42.252600 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:42.259084 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:42.259521 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:42.260306 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:42.260732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:42.386931 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:42.395110 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-b980fe46-7402-4c1c-a252-384251a41078 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.146790 Jan 27 16:57:42.395687 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 578/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:42 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:43.412058 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:43.412671 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:43.418949 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:43.419401 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:43.420202 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:43.420641 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:43.553569 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:43.560970 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f849299a-c2a2-4478-a11a-ba1029202431 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.153125 Jan 27 16:57:43.561622 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 600/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:43 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:44.578031 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:44.578670 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:44.585489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:44.585937 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:44.586721 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:44.587143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:44.715540 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:44.723959 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f7190091-e829-4da4-a6c6-449858bea8d5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.149473 Jan 27 16:57:44.724865 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 579/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:44 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:45.256741 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-b50ce951-c933-4e79-8ef2-429c6862e97a req-d7075d96-5e5b-471f-9463-3fe437025f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d4bea1-c26d-474d-ac97-d1a46389b65a", "name": "network-vif-plugged", "status": "completed", "tag": "b30a7664-8526-4f19-9578-bcd6d070fa17"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:57:45.258523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:57:45.258523 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:57:45.266362 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b50ce951-c933-4e79-8ef2-429c6862e97a req-d7075d96-5e5b-471f-9463-3fe437025f5a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:45.266867 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b50ce951-c933-4e79-8ef2-429c6862e97a req-d7075d96-5e5b-471f-9463-3fe437025f5a service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:45.278350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-b50ce951-c933-4e79-8ef2-429c6862e97a req-d7075d96-5e5b-471f-9463-3fe437025f5a service nova] Creating event network-vif-plugged:b30a7664-8526-4f19-9578-bcd6d070fa17 for instance 20d4bea1-c26d-474d-ac97-d1a46389b65a on hv-cinder-81883 Jan 27 16:57:45.283238 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-b50ce951-c933-4e79-8ef2-429c6862e97a req-d7075d96-5e5b-471f-9463-3fe437025f5a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Jan 27 16:57:45.284779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 601/1180] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:57:45.740551 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:45.741080 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:45.747942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:45.748386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:45.749147 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:45.749572 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:45.875613 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:45.884197 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-0d00a71f-99e9-46b8-8934-e28fbc459919 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1264 microversion: 2.1 time: 0.147413 Jan 27 16:57:45.884751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 580/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:45 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:46.902688 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:46.903309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:46.910139 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:46.910582 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:46.911350 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:46.911808 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:47.043783 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:47.051224 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-adeb6860-ec52-4e08-8595-98ffe3bc09c5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1449 microversion: 2.1 time: 0.153211 Jan 27 16:57:47.051816 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 602/1182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:46 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:47.067216 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:57:47.068268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:57:47.074049 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:47.074489 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:47.075375 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:47.075832 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:47.204534 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:57:47.213019 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-2a9c2dc2-63a8-4997-8c7b-299c54be2340 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1449 microversion: 2.1 time: 0.149919 Jan 27 16:57:47.213576 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 581/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:57:47 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:57:49.016197 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-d4935ecf-8c35-4e42-8aed-623e0540153c req-c58cae07-8b0b-4f8e-8e33-90ebe4dcfddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d4bea1-c26d-474d-ac97-d1a46389b65a", "tag": "b30a7664-8526-4f19-9578-bcd6d070fa17"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:57:49.018227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:57:49.018227 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:57:49.025886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-d4935ecf-8c35-4e42-8aed-623e0540153c req-c58cae07-8b0b-4f8e-8e33-90ebe4dcfddc service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:57:49.026334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-d4935ecf-8c35-4e42-8aed-623e0540153c req-c58cae07-8b0b-4f8e-8e33-90ebe4dcfddc service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:57:49.038072 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-d4935ecf-8c35-4e42-8aed-623e0540153c req-c58cae07-8b0b-4f8e-8e33-90ebe4dcfddc service nova] Creating event network-changed:b30a7664-8526-4f19-9578-bcd6d070fa17 for instance 20d4bea1-c26d-474d-ac97-d1a46389b65a on hv-cinder-81883 Jan 27 16:57:49.042935 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-d4935ecf-8c35-4e42-8aed-623e0540153c req-c58cae07-8b0b-4f8e-8e33-90ebe4dcfddc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 Jan 27 16:57:49.043823 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 603/1184] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:58:55.133257 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 16:58:55.133851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 16:58:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 16:59:23.187425 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1352740527", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-699219578", "security_groups": [{"name": "tempest-secgroup-smoke-962365757"}], "block_device_mapping_v2": [{"uuid": "70e9e146-2a1f-441f-9edc-673f22b5b2ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "31086914-ef67-4638-ab4e-856fdab7280e"}]}} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:59:23.441579 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.network.neutron [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] validate_networks() for [('31086914-ef67-4638-ab4e-856fdab7280e', None, None, None, None, None)] {{(pid=127795) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 27 16:59:23.897749 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 27 16:59:23.898172 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image limits 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 27 16:59:23.898645 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Flavor pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 27 16:59:23.899052 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Image pref 0:0:0 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 27 16:59:23.899463 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.virt.hardware [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127795) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 27 16:59:23.908716 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:23.908945 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:23.909675 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:23.910111 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:23.926970 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 27 16:59:23.930653 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.quota [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Getting quotas for user 6bf586d36da74c29ab1a188bb6da8603 and project 4d8774be86e84ff7a66787d6f67c554e. Resources: {'cores', 'ram', 'instances'} {{(pid=127795) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 27 16:59:23.983646 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Going to run 1 instances... {{(pid=127795) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 27 16:59:23.985694 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70e9e146-2a1f-441f-9edc-673f22b5b2ea',volume_size=None,volume_type=None)] {{(pid=127795) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 27 16:59:24.101578 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-4164c2da-3741-4963-ba13-03e85025203f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.918840 Jan 27 16:59:24.102216 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 582/1185] 10.222.0.48 () {60 vars in 1146 bytes} [Thu Jan 27 16:59:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 27 16:59:24.114642 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-f3a4b0ab-2fa1-403a-97bb-f7fb3ae79263 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:24.115357 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-f3a4b0ab-2fa1-403a-97bb-f7fb3ae79263 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:24.218840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-f3a4b0ab-2fa1-403a-97bb-f7fb3ae79263 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:24.232192 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-f3a4b0ab-2fa1-403a-97bb-f7fb3ae79263 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1094 microversion: 2.1 time: 0.123418 Jan 27 16:59:24.233131 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 604/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:24 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1094 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:25.250449 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:25.251263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:25.258366 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:25.258811 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:25.259611 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:25.260164 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:25.319333 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:25.326569 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7892576b-d944-4a77-a753-58707f2eb21b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1210 microversion: 2.1 time: 0.080505 Jan 27 16:59:25.327833 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 583/1187] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:25 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:26.343904 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:26.344583 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:26.352478 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:26.352930 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:26.353726 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:26.354162 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:26.538442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:26.546145 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [req-3dc1a408-c161-4628-87f2-cbd65c83c480 req-f51e1afa-09cb-46ec-87c4-c4a9e9228ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2744c8-1e9e-4d7f-b560-2d202b570f95", "tag": "a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae"}]} {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:59:26.546592 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-35503b11-94e8-4071-9a2e-b0d3c1b7e229 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.205946 Jan 27 16:59:26.547059 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 605/1188] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:26 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:26.556751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:59:26.556751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: warnings.warn(msg) Jan 27 16:59:26.556751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-3dc1a408-c161-4628-87f2-cbd65c83c480 req-f51e1afa-09cb-46ec-87c4-c4a9e9228ee2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:26.556751 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [req-3dc1a408-c161-4628-87f2-cbd65c83c480 req-f51e1afa-09cb-46ec-87c4-c4a9e9228ee2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:26.568564 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.compute.server_external_events [req-3dc1a408-c161-4628-87f2-cbd65c83c480 req-f51e1afa-09cb-46ec-87c4-c4a9e9228ee2 service nova] Creating event network-changed:a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae for instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 on hv-cinder-81883 Jan 27 16:59:26.573998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [req-3dc1a408-c161-4628-87f2-cbd65c83c480 req-f51e1afa-09cb-46ec-87c4-c4a9e9228ee2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127969 Jan 27 16:59:26.574837 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 584/1189] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 16:59:27.563859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:27.564468 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:27.571835 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:27.572281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:27.573038 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:27.573467 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:27.702544 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:27.710291 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-dcadff52-36e9-45fd-b000-f1de341a30dc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.150120 Jan 27 16:59:27.710886 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 606/1190] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:27 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:28.727284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:28.727998 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:28.733953 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:28.734393 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:28.735152 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:28.735589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:28.862279 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:28.870029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d07af28b-a0f3-45b0-881c-6872da80eec8 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.147161 Jan 27 16:59:28.870593 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 585/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:28 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:29.886812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:29.887357 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:29.893594 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:29.894075 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:29.894850 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:29.895281 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:30.027165 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:30.035001 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-3990c624-426c-4572-8cdc-49661c9234c6 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.151569 Jan 27 16:59:30.035840 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 607/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:29 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:31.051763 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:31.052381 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:31.058659 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:31.059108 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:31.059908 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:31.060344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:31.186714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:31.194547 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-07af243e-cf5c-4b8e-ba13-f484cc64ba9f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.146480 Jan 27 16:59:31.195108 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 586/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:31 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:32.210640 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:32.211251 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:32.217480 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:32.217926 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:32.218692 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:32.219125 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:32.348911 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:32.356213 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-e4fa9f14-fe4b-4a86-8a51-b0e6adefbb29 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.149307 Jan 27 16:59:32.356782 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 608/1194] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:32 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:33.373128 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:33.373691 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:33.381080 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:33.381524 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:33.382284 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:33.382714 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:33.512587 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:33.519938 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9707d258-f25b-48f2-8977-5a9438843a6d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.150511 Jan 27 16:59:33.520535 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 587/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:33 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:34.540085 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:34.540681 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:34.547005 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:34.547579 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:34.548230 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:34.548656 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:34.681703 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:34.689109 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-5936ede1-79db-4ef3-80a9-dd5135dec956 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.152650 Jan 27 16:59:34.689745 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 609/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:34 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:35.707024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:35.707658 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:35.713711 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:35.714159 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:35.714924 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:35.715352 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:35.845624 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:35.853911 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-340b9be3-47fe-4f54-b1d5-460d52dfaadd tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.151267 Jan 27 16:59:35.854527 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 588/1197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:35 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:35.914040 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-14917db8-02af-4971-a8c6-6bdc9e460245 req-b1ec30c9-c04c-441b-aa20-7051576d9e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2744c8-1e9e-4d7f-b560-2d202b570f95", "name": "network-vif-plugged", "status": "completed", "tag": "a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:59:35.915794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:59:35.915794 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:59:35.922680 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-14917db8-02af-4971-a8c6-6bdc9e460245 req-b1ec30c9-c04c-441b-aa20-7051576d9e2d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:35.923127 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-14917db8-02af-4971-a8c6-6bdc9e460245 req-b1ec30c9-c04c-441b-aa20-7051576d9e2d service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:35.934894 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-14917db8-02af-4971-a8c6-6bdc9e460245 req-b1ec30c9-c04c-441b-aa20-7051576d9e2d service nova] Creating event network-vif-plugged:a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae for instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 on hv-cinder-81883 Jan 27 16:59:35.939988 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-14917db8-02af-4971-a8c6-6bdc9e460245 req-b1ec30c9-c04c-441b-aa20-7051576d9e2d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090212 Jan 27 16:59:35.940755 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 610/1198] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 16:59:36.870542 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:36.871081 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:36.877263 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:36.877715 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:36.878910 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:36.879343 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:37.007610 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:37.014842 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f1376b92-2b36-44b9-91b5-7eae65d7a3b9 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1265 microversion: 2.1 time: 0.148029 Jan 27 16:59:37.015406 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 589/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:36 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:38.031799 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:38.032491 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:38.040713 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:38.041156 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:38.041921 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:38.042349 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:38.174068 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:38.181600 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-18142782-d858-48f2-91f9-bd1fda48519f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1451 microversion: 2.1 time: 0.153800 Jan 27 16:59:38.182166 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 611/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:38 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:38.198020 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 16:59:38.198629 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 16:59:38.204781 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:38.205259 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:38.206018 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:38.207183 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:38.333885 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 16:59:38.341078 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-f587c953-5e31-4a98-86cc-8d885bb49b03 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1451 microversion: 2.1 time: 0.146627 Jan 27 16:59:38.341640 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 590/1201] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 16:59:38 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 16:59:40.241311 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-93d35ba6-417e-4f5e-9adc-2503544015ac req-610ae74d-9b7f-40d7-b7ae-e2b239c667f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2744c8-1e9e-4d7f-b560-2d202b570f95", "tag": "a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 16:59:40.242819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:59:40.242819 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 16:59:40.249453 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-93d35ba6-417e-4f5e-9adc-2503544015ac req-610ae74d-9b7f-40d7-b7ae-e2b239c667f2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 16:59:40.249905 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-93d35ba6-417e-4f5e-9adc-2503544015ac req-610ae74d-9b7f-40d7-b7ae-e2b239c667f2 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 16:59:40.260984 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-93d35ba6-417e-4f5e-9adc-2503544015ac req-610ae74d-9b7f-40d7-b7ae-e2b239c667f2 service nova] Creating event network-changed:a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae for instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 on hv-cinder-81883 Jan 27 16:59:40.265837 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-93d35ba6-417e-4f5e-9adc-2503544015ac req-610ae74d-9b7f-40d7-b7ae-e2b239c667f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083870 Jan 27 16:59:40.266815 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 612/1202] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 16:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 17:00:26.070430 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:00:26.071057 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 17:00:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:00:29.748373 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:00:29.748927 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 17:00:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:01:11.839818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-4b419a4a-6d8d-4cb9-a3f9-0b9b6bf322ef req-76b66f32-45e9-43eb-a0ce-88dcd2f57201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad2744c8-1e9e-4d7f-b560-2d202b570f95", "tag": "a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 17:01:11.841336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 17:01:11.841336 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 17:01:11.846792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:11.847303 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:11.848796 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-4b419a4a-6d8d-4cb9-a3f9-0b9b6bf322ef req-76b66f32-45e9-43eb-a0ce-88dcd2f57201 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:11.849442 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-4b419a4a-6d8d-4cb9-a3f9-0b9b6bf322ef req-76b66f32-45e9-43eb-a0ce-88dcd2f57201 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:11.854214 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:11.854655 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:11.855461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:11.855897 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:11.861341 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-4b419a4a-6d8d-4cb9-a3f9-0b9b6bf322ef req-76b66f32-45e9-43eb-a0ce-88dcd2f57201 service nova] Creating event network-changed:a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae for instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 on hv-cinder-81883 Jan 27 17:01:11.867103 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-4b419a4a-6d8d-4cb9-a3f9-0b9b6bf322ef req-76b66f32-45e9-43eb-a0ce-88dcd2f57201 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Jan 27 17:01:11.867939 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 613/1203] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 17:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 17:01:11.885455 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 17:01:11.967982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-7761bb76-0890-45ce-b0ef-8ab9a418c124 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 204 len: 0 microversion: 2.1 time: 0.134687 Jan 27 17:01:11.968822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 591/1204] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 17:01:11 2022] DELETE /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 27 17:01:11.978984 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:11.979779 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:11.985854 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:11.986310 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:11.987102 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:11.987599 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:12.131932 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:12.139151 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-6d4ceede-f396-4ae2-a6ca-560d46b6af4f tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1576 microversion: 2.1 time: 0.164533 Jan 27 17:01:12.140384 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 614/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:11 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:13.157917 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:13.158732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:13.165167 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:13.165606 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:13.166383 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:13.166810 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:13.298934 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:13.306792 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-9e9eb29c-5933-4b31-9530-ab87709baf32 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1457 microversion: 2.1 time: 0.152858 Jan 27 17:01:13.307348 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 592/1206] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:13 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1457 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:13.940851 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-07d09c84-6f91-4e08-9b74-bb9851ac9a10 req-95a6cc8d-e88a-41eb-b41a-c212a296e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad2744c8-1e9e-4d7f-b560-2d202b570f95", "name": "network-vif-deleted", "tag": "a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 17:01:13.942637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 17:01:13.942637 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 17:01:13.950372 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-07d09c84-6f91-4e08-9b74-bb9851ac9a10 req-95a6cc8d-e88a-41eb-b41a-c212a296e9b6 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:13.950806 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-07d09c84-6f91-4e08-9b74-bb9851ac9a10 req-95a6cc8d-e88a-41eb-b41a-c212a296e9b6 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:13.963042 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-07d09c84-6f91-4e08-9b74-bb9851ac9a10 req-95a6cc8d-e88a-41eb-b41a-c212a296e9b6 service nova] Creating event network-vif-deleted:a78b9f54-8a81-4fb8-b4d8-c61c8b4e95ae for instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 on hv-cinder-81883 Jan 27 17:01:13.968590 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-07d09c84-6f91-4e08-9b74-bb9851ac9a10 req-95a6cc8d-e88a-41eb-b41a-c212a296e9b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031286 Jan 27 17:01:13.969335 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 615/1207] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 17:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 17:01:14.325211 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:14.325811 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:14.332732 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:14.333226 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:14.334024 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:14.334461 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:14.368547 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:14.368991 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:14.369434 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lazy-loading 'fault' on Instance uuid ad2744c8-1e9e-4d7f-b560-2d202b570f95 {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 17:01:14.408452 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:14.415586 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-d8474b47-90d3-4954-a922-6d560650ecb5 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 200 len: 1230 microversion: 2.1 time: 0.094106 Jan 27 17:01:14.416143 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 593/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:14 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:15.433888 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:15.434501 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: ad2744c8-1e9e-4d7f-b560-2d202b570f95] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:15.440586 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:15.441034 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:15.441848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:15.442279 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:15.454933 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] HTTP exception thrown: Instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 could not be found. Jan 27 17:01:15.455509 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Returning 404 to user: Instance ad2744c8-1e9e-4d7f-b560-2d202b570f95 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 17:01:15.456338 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-b4f9471f-ba3d-4685-bd8a-48ecbb50cd8b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95" status: 404 len: 111 microversion: 2.1 time: 0.027026 Jan 27 17:01:15.456859 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 616/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:15 2022] GET /compute/v2.1/servers/ad2744c8-1e9e-4d7f-b560-2d202b570f95 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 17:01:18.503268 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:18.503848 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:18.506198 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-47646e76-4004-475f-9c85-67e2bbc070d9 req-4f1f2c19-6a7c-47f7-9e64-baba57cd726c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d4bea1-c26d-474d-ac97-d1a46389b65a", "tag": "b30a7664-8526-4f19-9578-bcd6d070fa17"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 17:01:18.507856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 17:01:18.507856 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 17:01:18.511005 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:18.512243 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:18.513071 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:18.513507 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:18.515309 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-47646e76-4004-475f-9c85-67e2bbc070d9 req-4f1f2c19-6a7c-47f7-9e64-baba57cd726c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:18.515843 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-47646e76-4004-475f-9c85-67e2bbc070d9 req-4f1f2c19-6a7c-47f7-9e64-baba57cd726c service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:18.529095 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-47646e76-4004-475f-9c85-67e2bbc070d9 req-4f1f2c19-6a7c-47f7-9e64-baba57cd726c service nova] Creating event network-changed:b30a7664-8526-4f19-9578-bcd6d070fa17 for instance 20d4bea1-c26d-474d-ac97-d1a46389b65a on hv-cinder-81883 Jan 27 17:01:18.534191 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-47646e76-4004-475f-9c85-67e2bbc070d9 req-4f1f2c19-6a7c-47f7-9e64-baba57cd726c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032236 Jan 27 17:01:18.534978 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 617/1210] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 17:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 27 17:01:18.542649 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Going to try to terminate instance {{(pid=127795) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 27 17:01:18.636294 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a85169f0-b83a-469a-9e4a-20be45337761 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 204 len: 0 microversion: 2.1 time: 0.136386 Jan 27 17:01:18.637217 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 594/1211] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 17:01:18 2022] DELETE /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 27 17:01:18.646470 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:18.647431 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:18.656205 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:18.656651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:18.657633 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:18.658208 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:18.794765 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.policy [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127796) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:18.802945 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-ad541fec-10ae-41d9-abc8-0d4a30fa24fc tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1574 microversion: 2.1 time: 0.161150 Jan 27 17:01:18.803524 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 618/1212] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:18 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:19.821624 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:19.822318 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:19.828549 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:19.828996 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:19.829762 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:19.830193 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:19.963824 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:19.971089 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-249934ec-7fec-491b-a35f-815ec3fb72a4 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1455 microversion: 2.1 time: 0.154464 Jan 27 17:01:19.971674 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 595/1213] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:19 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:20.553221 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [req-b8966cce-53fb-4bbd-9ce7-b1d782b19eae req-acb223cf-ba5b-4259-bcc3-a568df74b700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d4bea1-c26d-474d-ac97-d1a46389b65a", "name": "network-vif-deleted", "tag": "b30a7664-8526-4f19-9578-bcd6d070fa17"}]} {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 27 17:01:20.554813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 17:01:20.554813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: warnings.warn(msg) Jan 27 17:01:20.562334 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b8966cce-53fb-4bbd-9ce7-b1d782b19eae req-acb223cf-ba5b-4259-bcc3-a568df74b700 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:20.562772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [req-b8966cce-53fb-4bbd-9ce7-b1d782b19eae req-acb223cf-ba5b-4259-bcc3-a568df74b700 service nova] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:20.574772 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.compute.server_external_events [req-b8966cce-53fb-4bbd-9ce7-b1d782b19eae req-acb223cf-ba5b-4259-bcc3-a568df74b700 service nova] Creating event network-vif-deleted:b30a7664-8526-4f19-9578-bcd6d070fa17 for instance 20d4bea1-c26d-474d-ac97-d1a46389b65a on hv-cinder-81883 Jan 27 17:01:20.579634 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [req-b8966cce-53fb-4bbd-9ce7-b1d782b19eae req-acb223cf-ba5b-4259-bcc3-a568df74b700 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 Jan 27 17:01:20.580344 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 619/1214] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Jan 27 17:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 27 17:01:20.987822 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:20.988589 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:20.994893 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:20.995337 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:20.996131 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:20.996559 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:21.026311 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:21.026759 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:21.027206 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.objects.instance [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lazy-loading 'fault' on Instance uuid 20d4bea1-c26d-474d-ac97-d1a46389b65a {{(pid=127795) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 27 17:01:21.067490 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.policy [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bf586d36da74c29ab1a188bb6da8603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8774be86e84ff7a66787d6f67c554e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127795) authorize /opt/stack/nova/nova/policy.py:199}} Jan 27 17:01:21.074756 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-688ef7c5-ba2a-4ae7-bacf-60b128b29234 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 200 len: 1229 microversion: 2.1 time: 0.090611 Jan 27 17:01:21.075344 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 596/1215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:20 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 1229 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 27 17:01:22.093848 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:22.094547 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: 20d4bea1-c26d-474d-ac97-d1a46389b65a] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:22.100812 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.101268 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.102041 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.102485 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.115232 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] HTTP exception thrown: Instance 20d4bea1-c26d-474d-ac97-d1a46389b65a could not be found. Jan 27 17:01:22.115844 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Returning 404 to user: Instance 20d4bea1-c26d-474d-ac97-d1a46389b65a could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 17:01:22.116651 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-fde664f0-3f07-4066-ac6e-15260aec226d tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a" status: 404 len: 111 microversion: 2.1 time: 0.027325 Jan 27 17:01:22.117170 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 620/1216] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:22 2022] GET /compute/v2.1/servers/20d4bea1-c26d-474d-ac97-d1a46389b65a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 17:01:22.554240 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:22.554717 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.compute.api [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127795) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:22.560900 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.561347 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.562122 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.562553 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG oslo_concurrency.lockutils [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127795) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.575981 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.wsgi [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] HTTP exception thrown: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. Jan 27 17:01:22.576562 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Returning 404 to user: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. {{(pid=127795) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 17:01:22.577409 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-fe083725-8889-495d-86db-bf9da79b009b tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 404 len: 111 microversion: 2.1 time: 0.027518 Jan 27 17:01:22.577942 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 597/1217] 10.222.0.48 () {58 vars in 1238 bytes} [Thu Jan 27 17:01:22 2022] DELETE /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 17:01:22.586203 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '>' {{(pid=127796) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:22.586818 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.compute.api [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] [instance: e76bd5f8-b0be-4230-8011-a683fcb41d21] Fetching instance by UUID {{(pid=127796) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 27 17:01:22.592730 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.593178 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.593948 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 27 17:01:22.594383 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG oslo_concurrency.lockutils [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Lock "86143b5f-d145-4abf-b204-d0c0e522ec94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127796) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 27 17:01:22.608340 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.wsgi [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] HTTP exception thrown: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. Jan 27 17:01:22.609047 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: DEBUG nova.api.openstack.wsgi [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Returning 404 to user: Instance e76bd5f8-b0be-4230-8011-a683fcb41d21 could not be found. {{(pid=127796) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 27 17:01:22.609682 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO nova.api.openstack.requestlog [None req-1d2a8e33-eec4-458f-9dc9-ed0f2e35d0d1 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21" status: 404 len: 111 microversion: 2.1 time: 0.027333 Jan 27 17:01:22.610234 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: [pid: 127796|app: 0|req: 621/1218] 10.222.0.48 () {58 vars in 1235 bytes} [Thu Jan 27 17:01:22 2022] GET /compute/v2.1/servers/e76bd5f8-b0be-4230-8011-a683fcb41d21 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 27 17:01:23.881619 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: DEBUG nova.api.openstack.wsgi [None req-a2de6307-db22-43dd-ade9-b9a53cc81591 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] Calling method '.version_select at 0x7f0cf0f18310>' {{(pid=127795) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 27 17:01:23.903184 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO nova.api.openstack.requestlog [None req-a2de6307-db22-43dd-ade9-b9a53cc81591 tempest-TestVolumeBootPattern-529611701 tempest-TestVolumeBootPattern-529611701-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-699219578" status: 202 len: 0 microversion: 2.1 time: 0.025985 Jan 27 17:01:23.904178 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: [pid: 127795|app: 0|req: 598/1219] 10.222.0.48 () {58 vars in 1259 bytes} [Thu Jan 27 17:01:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-699219578 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 27 17:02:03.967174 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:02:03.967982 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 17:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:02:15.141188 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:02:15.141791 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 17:02:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:03:46.078049 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:03:46.078684 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 17:03:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:03:49.757386 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:03:49.758215 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 17:03:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:04:05.230029 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:04:05.230677 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 17:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:04:15.539842 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:04:15.540371 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 17:04:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:05:23.975788 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:05:23.976470 dv-cinder-818830-2-iscsi devstack@n-api.service[127795]: Thu Jan 27 17:05:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 27 17:05:35.149813 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 27 17:05:35.150403 dv-cinder-818830-2-iscsi devstack@n-api.service[127796]: Thu Jan 27 17:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!